-- Logs begin at Mon 2022-08-29 19:24:47 UTC, end at Mon 2022-08-29 20:53:20 UTC. -- Aug 29 20:18:13.757122 dv-cinder-852009-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:18:13.767212 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:18:13 2022] *** Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: nodename: dv-cinder-852009-5-iscsi Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: machine: x86_64 Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: clock source: unix Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: pcre jit disabled Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: detected number of CPU cores: 4 Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: current working directory: / Aug 29 20:18:13.769206 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: your processes number limit is 47680 Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: your memory page size is 4096 bytes Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: detected max file descriptor number: 2048 Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: lock engine: pthread robust mutexes Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: thunder lock: enabled Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:18:13.770188 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:18:13.808885 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: Python main interpreter initialized at 0x5605e0eed9c0 Aug 29 20:18:13.808885 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: python threads support enabled Aug 29 20:18:13.808885 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: your server socket listen backlog is limited to 100 connections Aug 29 20:18:13.808885 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: *** Operational MODE: preforking *** Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: spawned uWSGI master process (pid: 106253) Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: spawned uWSGI worker 1 (pid: 106254, cores: 1) Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: spawned uWSGI worker 2 (pid: 106255, cores: 1) Aug 29 20:18:13.813684 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:18:13.809720 dv-cinder-852009-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:18:14.476423 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:18:14.477112 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:18:15.575393 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:18:15.575393 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: from cryptography.utils import int_from_bytes Aug 29 20:18:15.575989 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:18:15.575989 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: from cryptography.utils import int_from_bytes Aug 29 20:18:15.576397 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:18:15.576397 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: from cryptography.utils import int_from_bytes Aug 29 20:18:15.576512 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:18:15.576512 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: from cryptography.utils import int_from_bytes Aug 29 20:18:18.052770 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:18:18.053312 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:18:18.053539 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:18:18.053905 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:18:18.054160 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:18:18.054545 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.054880 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.055192 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.055511 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.055840 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.056150 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.056495 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.056813 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.056899 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:18:18.057252 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:18:18.057343 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.057425 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.057616 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:18:18.057730 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.057989 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:18:18.058088 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-5-iscsi {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.058247 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:18:18.058344 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.058597 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.058684 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.058906 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059002 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059224 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059311 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059528 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059620 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.059951 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.060156 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.060316 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.060531 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.060671 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.060854 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061111 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061247 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061422 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061525 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061735 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.061840 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062139 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062302 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-5-iscsi {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062467 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062764 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.062855 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063086 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063177 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063391 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063481 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063715 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.063821 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064022 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064107 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064362 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064494 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-5-iscsi {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064745 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.064873 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065057 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065194 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065370 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065504 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065783 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.065872 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066095 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066190 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066406 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066491 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066726 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.066811 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067059 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067159 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067367 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067457 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067691 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.067790 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068009 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068129 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068353 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068470 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-5-iscsi {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068678 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068778 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.068983 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069084 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069292 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069391 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069604 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069751 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.069929 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070087 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070242 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070380 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070517 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070674 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.070817 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071003 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071148 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071317 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071449 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071647 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071780 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.071972 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072112 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072270 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072375 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072547 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072643 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.072852 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073008 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073205 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073358 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073489 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073578 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073798 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.073888 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074108 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074195 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074417 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074578 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074667 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074747 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.074962 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075055 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075294 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075390 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075612 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.075933 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076029 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076202 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076306 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076584 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076781 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.076893 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.077106 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.077202 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.077418 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078127 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078247 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078387 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078558 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078698 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.078868 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079038 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079179 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079357 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079489 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079666 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079800 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.079986 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080109 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080333 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080468 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080642 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080787 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.080951 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081113 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081258 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081423 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081577 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081748 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.081916 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082152 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082247 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082522 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082732 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.082831 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083038 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083147 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083355 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083451 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083669 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083765 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.083964 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084064 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084296 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084393 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084598 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084708 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084902 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.084999 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085206 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085292 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085510 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085596 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085814 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.085903 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086118 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086211 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086402 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086487 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086710 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.086797 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087012 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087106 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087316 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087412 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087630 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087716 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.087941 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088028 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088268 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088372 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088573 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088661 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088876 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.088976 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089185 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089285 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089489 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089576 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089792 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.089877 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090097 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090202 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090402 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090486 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090706 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.090797 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091009 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091112 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091316 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091402 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091618 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091703 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.091926 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092021 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092262 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092351 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092562 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092649 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092866 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.092963 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.093173 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.093914 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094054 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094142 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094363 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094667 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094756 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.094971 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095068 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095274 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095371 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095580 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095667 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095882 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.095969 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096204 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096366 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096520 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096660 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096805 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.096950 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097119 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097274 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097419 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097555 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097719 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.097858 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098007 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098143 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098329 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098476 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098635 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.098765 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.098943 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.099093 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.099251 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.099384 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.099559 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.099699 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.099866 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.100002 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.100188 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.100335 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.100498 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.100640 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.100820 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.100957 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.101146 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.101281 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.101458 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.101600 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.101769 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.101913 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.102079 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.102210 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.102403 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:18:18.102644 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.102789 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.102925 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103060 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103204 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103347 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103483 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103647 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103785 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.103965 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104127 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104311 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104402 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104626 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104714 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.104946 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105052 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105275 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105376 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105597 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105685 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.105909 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106006 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106222 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106309 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106540 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106628 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106865 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.106953 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107190 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107278 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107509 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107595 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107822 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.107920 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108133 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108286 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108470 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108558 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108785 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.108882 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109133 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109228 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109447 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109533 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109766 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.109861 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110077 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110173 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110402 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110490 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110715 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.110814 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111027 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111117 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111339 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111431 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111652 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111748 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.111964 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112058 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112304 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112397 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112622 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112711 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.112944 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113033 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113261 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113355 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113573 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113661 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113889 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.113976 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114201 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114301 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114512 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114600 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114821 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.114908 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115111 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115201 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115422 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115511 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115727 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.115839 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116037 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116132 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116369 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116458 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116689 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.116782 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117112 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117325 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117412 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117638 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117723 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.117952 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118046 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118263 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118360 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118570 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118741 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118880 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.118978 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119184 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119270 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119493 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119580 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119802 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.119957 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120108 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120247 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120442 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120537 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120756 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.120851 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121060 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121147 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121379 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121472 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121690 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121784 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.121998 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122093 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122309 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122403 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122621 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122709 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.122932 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123018 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123239 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123343 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123552 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123640 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123861 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.123954 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124187 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124294 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124539 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124627 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124855 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.124943 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125169 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125372 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125500 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125610 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125814 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.125903 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126123 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126223 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126442 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126529 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126751 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.126838 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127063 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127158 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127368 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127454 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127673 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127767 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.127979 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128077 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128315 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128406 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128625 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128714 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.128933 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129024 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129239 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129326 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129546 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129677 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129853 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.129950 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130174 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130262 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130485 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130585 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130789 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.130883 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131094 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131181 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131399 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131494 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131705 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.131791 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132016 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132105 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132352 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132458 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132661 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132748 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.132971 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133057 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133278 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133370 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133586 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133676 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133893 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.133987 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134219 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134350 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134531 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134620 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134837 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.134924 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135148 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135250 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135457 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135562 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135769 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.135862 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136091 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136202 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136431 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136517 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136757 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.136843 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137070 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137160 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137392 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137485 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137699 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.137786 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138018 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138111 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138335 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138423 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138650 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138748 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.138967 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139053 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139281 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139375 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139591 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139695 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139908 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.139999 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.140772 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.140866 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141087 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141188 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141399 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141487 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141710 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.141797 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142032 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142129 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142341 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142659 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142752 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.142969 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143067 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143293 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143390 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143603 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143691 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.143923 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.144018 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.144254 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.144348 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.144843 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.144940 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145158 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145246 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145481 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145598 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145788 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.145878 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146100 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146190 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146420 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146507 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146733 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.146819 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147046 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147136 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147357 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147442 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147663 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147758 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.147969 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148056 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148309 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148416 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148620 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148715 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.148949 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149034 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149246 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149343 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149553 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149655 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149870 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.149956 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150182 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150283 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150491 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150591 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150797 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.150884 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151109 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151202 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151425 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151514 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151735 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.151829 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152043 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152130 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152392 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152482 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152697 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.152782 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153004 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153091 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153419 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153626 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153723 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.153929 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154022 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154233 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154322 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154538 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154628 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.154845 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155008 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155161 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155249 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155469 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155571 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155837 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.155941 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156160 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156267 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156492 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156591 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156802 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.156898 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157113 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157200 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157423 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157508 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157740 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.157835 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158050 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158160 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158356 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158443 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158664 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158751 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.158973 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159058 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159288 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159383 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159600 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159688 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.159917 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160009 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160249 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160340 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160563 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160664 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160874 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.160961 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161181 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161267 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161490 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161580 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161808 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.161896 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.162123 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.162380 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.162470 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.162714 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.162802 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163030 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163117 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163345 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163460 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163661 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163760 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.163989 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164085 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164324 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164437 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164641 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164738 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.164954 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165095 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165260 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165400 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165570 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165718 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.165863 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166002 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166171 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166447 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166586 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166776 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.166939 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167070 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167206 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167354 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167491 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167667 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167808 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.167974 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168115 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168305 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168435 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168611 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168771 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.168919 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169093 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169238 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169408 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169547 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169725 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.169857 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170036 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170162 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170346 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170487 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170662 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170798 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.170973 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.171103 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.171283 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.171932 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172115 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172268 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172457 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172613 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172767 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.172920 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173076 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173262 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173384 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173594 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173685 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.173939 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174035 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174248 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174344 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174555 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174642 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174882 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.174970 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175189 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175285 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175496 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175583 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175800 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.175931 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176110 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176237 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176448 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176542 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176753 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.176840 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177066 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177162 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177377 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177465 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177689 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.177784 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178001 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178089 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178306 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178400 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178704 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.178924 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179012 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179240 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179341 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179553 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179651 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179857 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.179948 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180183 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180275 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180493 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180596 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180803 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.180890 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181108 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181197 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181419 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181514 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181723 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.181808 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182038 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182130 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182349 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182445 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182653 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182745 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.182960 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183047 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183270 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183365 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183582 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183669 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183886 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.183979 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184209 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184299 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184530 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184626 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184836 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.184924 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185142 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185230 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185452 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185538 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185757 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.185851 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186063 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186160 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186373 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186460 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186680 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.186765 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.187031 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.187144 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.187385 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.187701 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.187796 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.188007 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.188442 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.188611 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.188758 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.188935 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189074 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189268 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189381 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189587 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189675 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189901 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.189988 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190217 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190332 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190533 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190681 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190842 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.190975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191152 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191291 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191445 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191581 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191752 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.191900 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192058 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192248 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192410 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192498 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192726 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.192823 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193034 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193128 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193343 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193430 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193652 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193794 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.193965 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194053 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194272 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194359 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194581 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194681 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194889 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.194992 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195195 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195281 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195500 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195587 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195809 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.195955 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196128 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196250 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196459 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196550 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196765 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.196854 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197076 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197163 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197388 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197476 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197700 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.197795 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198022 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198109 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198346 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198434 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198664 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198764 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.198968 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199063 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199278 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199366 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199589 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199675 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.199900 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200006 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200328 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200539 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200637 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200850 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.200951 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201160 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201254 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201465 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201550 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201774 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.201869 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.202082 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.202168 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.202393 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.202480 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203241 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203345 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203551 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203646 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203860 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.203959 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204198 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204300 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204511 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204597 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204820 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.204970 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205119 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205257 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205423 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205564 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205733 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.205869 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206024 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206159 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206348 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206480 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206664 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206796 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.206978 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207116 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207296 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207428 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207609 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207755 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.207901 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208046 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208237 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208372 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208552 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208694 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208859 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.208997 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.209187 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.209326 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.209499 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.209713 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.209892 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210032 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210171 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210306 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210449 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210593 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210726 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.210868 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211012 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211155 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211379 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211516 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211685 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211818 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.211990 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212128 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212319 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212417 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212634 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212727 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.212943 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213032 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213258 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213345 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213576 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213670 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213886 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.213974 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.214263 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.214350 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.214612 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.214697 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.214928 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215024 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215244 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215340 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215552 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215639 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215860 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.215957 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216189 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216336 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216512 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216599 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216817 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.216912 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217124 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217211 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217437 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217531 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217759 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.217855 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.218063 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.218170 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.218929 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219042 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219241 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219338 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219565 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219667 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219890 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.219978 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.220228 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.220397 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.220573 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.220713 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.220958 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221057 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221283 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221371 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221594 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221683 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.221917 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222011 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222247 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222335 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222555 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222651 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222866 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.222952 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223175 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223262 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223481 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223570 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223788 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.223876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224112 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224229 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224446 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224533 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224760 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.224849 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225073 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225181 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225384 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225473 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225691 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225779 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.225996 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226098 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226320 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226431 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226625 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226744 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.226949 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227071 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227264 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227405 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227587 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227714 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.227910 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228022 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228239 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228362 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228567 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228667 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228881 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.228971 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229190 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229279 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229497 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229586 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229806 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.229903 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230150 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230237 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230455 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230542 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230769 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.230867 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231078 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231172 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231404 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231500 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231711 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.231788 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232038 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232135 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232376 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232478 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232704 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.232792 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233026 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233113 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233335 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233436 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233648 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233743 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.233983 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234073 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234290 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234388 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234596 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234682 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234902 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.234996 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235208 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235297 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235520 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235608 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235829 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.235916 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236137 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236275 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236472 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236560 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236797 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.236885 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237102 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237192 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237428 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237515 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237740 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.237836 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238048 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238135 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238356 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238443 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238663 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238763 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.238980 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239067 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239298 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239384 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239608 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239704 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.239917 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240013 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240246 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240339 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240561 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240661 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240871 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.240959 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241178 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241268 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241487 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241576 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241803 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.241889 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242110 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242197 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242426 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242513 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242736 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.242830 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243044 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243139 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243353 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243442 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243662 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.243751 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.244008 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.244206 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.244342 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.244546 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.244867 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245026 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245187 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245348 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245680 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.245823 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246005 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246142 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246397 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246488 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246726 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.246830 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247050 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247145 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247370 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247694 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.247780 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248015 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248102 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248357 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248449 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248681 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.248792 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249002 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249100 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249320 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249406 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249664 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249875 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.249984 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250210 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250348 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250532 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250650 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250850 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.250947 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251169 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251267 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251488 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251584 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251807 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.251904 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252125 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252248 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252467 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252555 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252786 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.252886 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253104 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253192 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253417 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253505 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253732 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.253836 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254047 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254142 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254359 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254447 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254686 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.254776 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255009 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255096 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255330 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255424 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255642 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255742 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.255958 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256045 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256297 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256400 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256632 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256823 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.256970 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257140 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257266 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257474 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257591 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257801 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.257963 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258127 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258223 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258444 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258540 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258763 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.258861 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259090 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259187 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259399 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259495 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259707 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.259801 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260021 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260125 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260359 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260495 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260667 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260764 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.260992 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261090 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261306 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261404 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261610 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.261926 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.262022 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.262236 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.262459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.262775 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.262871 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.263125 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.263432 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.263520 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.263759 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.263853 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264087 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264203 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264521 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264742 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.264829 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.265598 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.265708 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.265916 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266006 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266222 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266306 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266541 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266619 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266856 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.266940 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267164 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267241 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267472 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267550 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267787 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.267863 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268097 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268209 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268432 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268511 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268744 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.268827 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.269049 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.269378 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.269481 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.269967 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270065 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270220 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270310 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270523 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270620 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270837 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.270927 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271146 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271242 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271455 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271560 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271762 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.271851 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272068 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272156 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272401 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272499 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272706 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.272793 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273018 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273114 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273325 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273413 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273635 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273721 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.273942 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274042 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274254 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274342 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274562 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274651 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.274973 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275184 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275272 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275500 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275586 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275810 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.275905 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276120 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276234 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276451 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276554 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276768 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.276866 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277077 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277165 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277387 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277483 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.277787 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278014 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278254 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278350 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278590 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278691 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.278914 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279002 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279219 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279322 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279535 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279644 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279840 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.279931 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.280153 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.280273 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.280484 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.280651 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.281416 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.281556 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.281678 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.281766 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.281985 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282081 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282298 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282384 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282613 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282715 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.282923 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283012 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283241 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283348 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283549 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283637 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283860 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.283960 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.284217 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.284311 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.284505 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.284766 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.284877 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285107 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285195 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285417 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285517 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285725 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.285862 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286041 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286129 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286382 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286469 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286693 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.286782 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287002 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287090 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287316 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287403 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287632 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287720 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.287945 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288039 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288281 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288386 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288594 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288681 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288906 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.288992 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289222 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289318 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289578 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289679 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289846 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.289934 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290247 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290580 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290771 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.290895 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291083 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291216 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291396 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291544 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291711 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.291856 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292026 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292207 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292397 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292528 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292719 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.292840 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293042 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293170 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293362 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293484 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293681 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293814 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.293996 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294156 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294310 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294486 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294621 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294810 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.294933 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295115 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295254 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295422 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295590 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295727 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.295910 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.296037 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.296245 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.296405 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.296703 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.296805 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297012 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297099 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297317 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297411 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297629 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297725 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.297934 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298022 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298239 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298326 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298543 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298632 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298848 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.298935 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299157 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299251 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299462 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299551 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299770 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.299871 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300074 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300199 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300405 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300494 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300710 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.300798 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301120 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301325 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301413 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301633 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301749 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.301939 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302061 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302243 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302342 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302548 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302645 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.302901 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303013 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303159 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303261 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303559 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303778 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.303875 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304086 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304196 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304420 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304519 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304728 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.304817 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305042 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305130 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305350 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305439 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305658 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305747 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.305965 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306052 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306275 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306361 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306580 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306667 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306887 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.306974 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307200 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307301 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307508 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307596 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307818 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.307912 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308123 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308245 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308455 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308543 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308764 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.308852 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309096 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309192 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309406 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309494 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309732 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.309874 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310039 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310125 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310360 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310452 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310676 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310765 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.310990 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311078 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311316 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311404 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311625 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311734 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.311959 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312068 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312296 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312389 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312609 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312711 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.312921 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313012 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313235 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313322 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313549 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313644 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313861 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.313955 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314180 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314275 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314494 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314592 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314826 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.314922 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315159 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315247 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315473 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315570 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315801 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.315888 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316122 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316241 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316496 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316586 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316813 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.316901 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317159 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317246 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317491 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317587 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317809 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.317896 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.318123 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.318210 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.318428 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.318516 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.318672 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:18:18.318760 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.319037 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.319356 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.319674 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.319993 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.320341 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.320664 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.320998 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.321331 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.321646 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.322017 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.322310 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.322663 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.322983 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.323331 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.323663 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.323982 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.324335 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.324647 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:18:18.324893 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:18:18.474928 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO dbcounter [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Registered counter for database nova_api Aug 29 20:18:18.481135 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO dbcounter [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Registered counter for database nova_api Aug 29 20:18:18.496903 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_db.sqlalchemy.engines [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.501371 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_db.sqlalchemy.engines [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.504334 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writer thread running {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.507908 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writer thread running {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.562699 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.context [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),103c962f-eb80-4bbe-a755-160f136dba1f(cell1) {{(pid=106255) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:18:18.566516 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.567004 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.568592 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.569320 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.569431 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.context [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),103c962f-eb80-4bbe-a755-160f136dba1f(cell1) {{(pid=106254) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:18:18.569770 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.571735 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.573381 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.573736 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO dbcounter [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Registered counter for database nova_cell0 Aug 29 20:18:18.573862 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.575446 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.576184 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.576648 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.578501 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO dbcounter [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Registered counter for database nova_cell1 Aug 29 20:18:18.579214 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_concurrency.lockutils [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.581212 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO dbcounter [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Registered counter for database nova_cell0 Aug 29 20:18:18.585351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO dbcounter [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Registered counter for database nova_cell1 Aug 29 20:18:18.586349 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_db.sqlalchemy.engines [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.588668 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_db.sqlalchemy.engines [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.592213 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_db.sqlalchemy.engines [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.594380 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_db.sqlalchemy.engines [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.596437 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writer thread running {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.596795 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writer thread running {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.599322 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writer thread running {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.602179 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writer thread running {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.741734 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO dbcounter [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Registered counter for database nova_cell0 Aug 29 20:18:18.747049 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO dbcounter [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Registered counter for database nova_cell0 Aug 29 20:18:18.751002 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_db.sqlalchemy.engines [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.755729 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writer thread running {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:18.756110 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG oslo_db.sqlalchemy.engines [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:18:18.760534 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writer thread running {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:18:19.257078 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: WARNING keystonemiddleware.auth_token [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:18:19.264391 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: WARNING keystonemiddleware.auth_token [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:18:19.281523 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: WARNING keystonemiddleware.auth_token [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:18:19.288851 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: WARNING keystonemiddleware.auth_token [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:18:19.608489 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: WARNING keystonemiddleware.auth_token [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:18:19.617855 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: WARNING keystonemiddleware.auth_token [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:18:19.620208 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605e0eed9c0 pid: 106255 (default app) Aug 29 20:18:19.622272 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:19.623487 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Aug 29 20:18:19.623896 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Mon Aug 29 20:18:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:19.634909 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: WARNING keystonemiddleware.auth_token [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:18:19.640983 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: WARNING keystonemiddleware.auth_token [None req-91310a7c-03d8-490c-a105-60b0bff65161 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:18:19.646520 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605e0eed9c0 pid: 106254 (default app) Aug 29 20:19:41.819097 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:41.820332 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 29 20:19:41.820845 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:41.832904 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_api:SELECT=3 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:41.834251 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_cell1:SELECT=3 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:41.835072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_cell0:SELECT=3 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:41.836615 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:42.687852 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3116b6f3-cb79-49b9-8dd9-1f9ed3f1671f admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:42.723168 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3116b6f3-cb79-49b9-8dd9-1f9ed3f1671f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895426 Aug 29 20:19:42.726625 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1292 bytes} [Mon Aug 29 20:19:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:45.075463 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:45.076497 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-852083d1-25a0-4cc5-9f79-2d18e6068fb8 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 29 20:19:45.077059 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:45.513723 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-a94b116a-3f20-46bc-a8ac-f04f65c70707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:45.650115 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-a94b116a-3f20-46bc-a8ac-f04f65c70707 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.566787 Aug 29 20:19:45.651440 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:19:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:19:45.886520 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-5b59a67a-3388-466f-a4c3-14593ce64120 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:45.892906 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_api:SELECT=3 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:45.893714 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_cell0:SELECT=3 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:45.894854 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_cell1:SELECT=3 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:45.895549 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:46.085045 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-5b59a67a-3388-466f-a4c3-14593ce64120 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.424542 Aug 29 20:19:46.085744 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1336 bytes} [Mon Aug 29 20:19:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:48.440037 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-a94b116a-3f20-46bc-a8ac-f04f65c70707 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:48.441819 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-a94b116a-3f20-46bc-a8ac-f04f65c70707 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 29 20:19:48.442428 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:49.087432 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-8c4d2af8-4a3f-415d-93cf-0a347804c829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "ram": 512, "disk": 5, "swap": 0}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:49.261820 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-8c4d2af8-4a3f-415d-93cf-0a347804c829 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.812441 Aug 29 20:19:49.262387 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:19:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:49.274588 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-63c9f760-6a08-4afe-a371-d0575f4c3d9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:49.389099 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-63c9f760-6a08-4afe-a371-d0575f4c3d9a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118167 Aug 29 20:19:49.390106 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1336 bytes} [Mon Aug 29 20:19:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:51.746476 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-8c4d2af8-4a3f-415d-93cf-0a347804c829 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:51.747472 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-8c4d2af8-4a3f-415d-93cf-0a347804c829 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Aug 29 20:19:51.747881 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:52.140204 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-87f3dc0e-b6db-4540-8e26-48d5b0339c3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:52.248001 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-87f3dc0e-b6db-4540-8e26-48d5b0339c3b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493940 Aug 29 20:19:52.248592 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:19:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:19:52.260543 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-0c02d34e-202c-4bee-b89b-1f1f50c6b07b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:52.344698 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-0c02d34e-202c-4bee-b89b-1f1f50c6b07b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087714 Aug 29 20:19:52.345289 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1336 bytes} [Mon Aug 29 20:19:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:54.693191 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-87f3dc0e-b6db-4540-8e26-48d5b0339c3b admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:54.694888 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-87f3dc0e-b6db-4540-8e26-48d5b0339c3b admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 Aug 29 20:19:54.696036 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:55.136703 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-a6dceb23-132d-4fea-a068-faeb07ef86cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:55.266048 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-a6dceb23-132d-4fea-a068-faeb07ef86cf admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562694 Aug 29 20:19:55.268271 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:19:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:55.279803 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-16983a15-4405-4cba-893c-88dc5b6d032b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:55.389677 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-16983a15-4405-4cba-893c-88dc5b6d032b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113992 Aug 29 20:19:55.390869 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1336 bytes} [Mon Aug 29 20:19:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:57.737230 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-a6dceb23-132d-4fea-a068-faeb07ef86cf admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:57.738230 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-a6dceb23-132d-4fea-a068-faeb07ef86cf admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 29 20:19:57.738857 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:58.158965 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d4", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:58.249366 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504420 Aug 29 20:19:58.250105 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:19:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:58.263070 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-fda0e58a-d9f9-4148-9e96-1b34a70c59e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:58.355387 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-fda0e58a-d9f9-4148-9e96-1b34a70c59e2 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096455 Aug 29 20:19:58.356274 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1336 bytes} [Mon Aug 29 20:19:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:00.682812 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:00.683866 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 29 20:20:00.684431 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:01.102877 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-809741cc-f670-4d1e-bfba-53346db3fb5e admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:01.128134 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-809741cc-f670-4d1e-bfba-53346db3fb5e admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437655 Aug 29 20:20:01.128740 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1292 bytes} [Mon Aug 29 20:20:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:03.551190 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:03.552268 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-4af8f038-9cd2-4d0a-9a72-33c8d400022f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001739 Aug 29 20:20:03.552802 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:03.967350 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-25ca389e-33b7-449d-a293-2b89a4299b40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:04.077070 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-25ca389e-33b7-449d-a293-2b89a4299b40 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518060 Aug 29 20:20:04.077646 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:20:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:04.090546 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-61db52e5-d1c0-40a1-a78b-4ef9257ef77b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:04.206183 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-61db52e5-d1c0-40a1-a78b-4ef9257ef77b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119935 Aug 29 20:20:04.206787 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1333 bytes} [Mon Aug 29 20:20:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:06.616800 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-25ca389e-33b7-449d-a293-2b89a4299b40 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:06.617820 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-25ca389e-33b7-449d-a293-2b89a4299b40 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 29 20:20:06.618221 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:07.040494 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-33786fb1-17b8-41e4-aec2-5c6e7330b809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "vcpus": 1}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:07.185798 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-33786fb1-17b8-41e4-aec2-5c6e7330b809 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.560634 Aug 29 20:20:07.189106 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:20:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:07.201991 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-7a545dae-23d4-4424-97d9-5e9acea4dcef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:07.364730 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-7a545dae-23d4-4424-97d9-5e9acea4dcef admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.168259 Aug 29 20:20:07.365306 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1333 bytes} [Mon Aug 29 20:20:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:09.679385 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-33786fb1-17b8-41e4-aec2-5c6e7330b809 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:09.680480 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-33786fb1-17b8-41e4-aec2-5c6e7330b809 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 29 20:20:09.680892 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:10.077483 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-d827b253-dbc2-4543-81d4-d95edae600bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:10.196653 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-d827b253-dbc2-4543-81d4-d95edae600bf admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509632 Aug 29 20:20:10.197214 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:20:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:10.209457 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-141eaa7a-fa4e-4949-968f-7576a279d22a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:10.378112 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-141eaa7a-fa4e-4949-968f-7576a279d22a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.172333 Aug 29 20:20:10.378697 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1333 bytes} [Mon Aug 29 20:20:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:20:12.762206 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-d827b253-dbc2-4543-81d4-d95edae600bf admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:12.763340 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-d827b253-dbc2-4543-81d4-d95edae600bf admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Aug 29 20:20:12.763742 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:13.173571 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-82ed2029-32fe-4455-8411-391eb2545b04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "disk": 80, "vcpus": 4, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:13.179181 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:13.275535 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-82ed2029-32fe-4455-8411-391eb2545b04 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.504739 Aug 29 20:20:13.276083 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:20:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:13.288539 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-69f2319a-9a09-46fd-bb6e-b875d5681014 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:13.375410 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-69f2319a-9a09-46fd-bb6e-b875d5681014 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090893 Aug 29 20:20:13.375974 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1333 bytes} [Mon Aug 29 20:20:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:15.785575 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-82ed2029-32fe-4455-8411-391eb2545b04 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:15.786672 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-82ed2029-32fe-4455-8411-391eb2545b04 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 29 20:20:15.787212 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:16.225482 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:16.231434 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:16.350794 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.557094 Aug 29 20:20:16.351753 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1283 bytes} [Mon Aug 29 20:20:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:20:16.364464 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3a18c962-f630-4f1c-8a8b-de0ed50a4eba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:16.497894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3a18c962-f630-4f1c-8a8b-de0ed50a4eba admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137337 Aug 29 20:20:16.498459 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1333 bytes} [Mon Aug 29 20:20:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:40.517230 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:40.518270 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 29 20:20:40.518929 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:20:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:40.912862 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-c4316163-dc67-4981-907b-44d25ec7254b admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:40.932682 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-c4316163-dc67-4981-907b-44d25ec7254b admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407117 Aug 29 20:20:40.933220 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1292 bytes} [Mon Aug 29 20:20:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:41.981432 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:41.982434 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-bc482c6b-f145-441c-b325-001441af64b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 29 20:20:41.982832 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:42.503018 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-1f8f85dc-187a-42d9-8fc4-d157b30c6385 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.508752 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.wsgi [None req-1f8f85dc-187a-42d9-8fc4-d157b30c6385 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-1f8f85dc-187a-42d9-8fc4-d157b30c6385 admin admin] Request method failure captured: Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept: application/json Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept-Encoding: gzip, deflate Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Connection: keep-alive Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Content-Length: 0 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Host: 10.222.0.85 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-System-Scope: None Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: User-Agent: python-novaclient Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Auth-Token: gAAAAABjDR-ZW5n5yqqnw-j-E3tPLXn6XSp7xJGl5gcAD91cDZZxwsBOYVqRcRgGbE8yJ515GJrp-l9EeHv9QazUFOPwGwIGxbaBLteShqevUVIwjJ7HkW1fcwuGveCa6PK4EqRmAWoIDTpWVeNNqJhx4dSB0pNrF3mugDK2POD2mVnskxwF2M0 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Id: None Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Name: None Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Identity-Status: Confirmed Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Is-Admin-Project: True Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Id: default Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Name: Default Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Name: admin Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Role: reader,admin,member Aug 29 20:20:42.512614 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Roles: reader,admin,member Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant: admin Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Name: admin Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User: admin Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Id: default Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Name: Default Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Name: admin Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: method: > Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: exception: Flavor 42 could not be found. Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: action_args: {'id': '42'} Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:42.514414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.515319 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.516471 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-1f8f85dc-187a-42d9-8fc4-d157b30c6385 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:42.517737 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-1f8f85dc-187a-42d9-8fc4-d157b30c6385 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395608 Aug 29 20:20:42.517737 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Mon Aug 29 20:20:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:42.524104 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-c636ac9d-563c-4384-9857-90dabb71e790 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.546210 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-c636ac9d-563c-4384-9857-90dabb71e790 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025817 Aug 29 20:20:42.546757 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:42.556892 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-a8607414-5471-47be-85f2-7b86afcbf160 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.579560 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-a8607414-5471-47be-85f2-7b86afcbf160 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026767 Aug 29 20:20:42.580092 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:42.589230 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-061ceb7e-fdd4-4bfe-83fc-d926dc38b41f admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:42.594736 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.wsgi [None req-061ceb7e-fdd4-4bfe-83fc-d926dc38b41f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-061ceb7e-fdd4-4bfe-83fc-d926dc38b41f admin admin] Request method failure captured: Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept: application/json Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept-Encoding: gzip, deflate Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Connection: keep-alive Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Content-Length: 0 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Host: 10.222.0.85 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-System-Scope: None Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: User-Agent: python-novaclient Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Auth-Token: gAAAAABjDR-ZW5n5yqqnw-j-E3tPLXn6XSp7xJGl5gcAD91cDZZxwsBOYVqRcRgGbE8yJ515GJrp-l9EeHv9QazUFOPwGwIGxbaBLteShqevUVIwjJ7HkW1fcwuGveCa6PK4EqRmAWoIDTpWVeNNqJhx4dSB0pNrF3mugDK2POD2mVnskxwF2M0 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Id: None Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Name: None Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Identity-Status: Confirmed Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Is-Admin-Project: True Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Id: default Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Name: Default Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Name: admin Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Role: reader,admin,member Aug 29 20:20:42.598016 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Roles: reader,admin,member Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant: admin Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Name: admin Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User: admin Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Id: default Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Name: Default Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Name: admin Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: method: > Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: exception: Flavor 42 could not be found. Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: action_args: {'id': '42'} Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:42.599504 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.600569 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:42.601935 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-061ceb7e-fdd4-4bfe-83fc-d926dc38b41f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:42.602961 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-061ceb7e-fdd4-4bfe-83fc-d926dc38b41f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013685 Aug 29 20:20:42.602961 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Mon Aug 29 20:20:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:43.568233 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-a8607414-5471-47be-85f2-7b86afcbf160 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.569290 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-a8607414-5471-47be-85f2-7b86afcbf160 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 29 20:20:43.569686 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:44.095066 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-450f5d27-5dff-4d7e-ab1a-9ad9f47db4e0 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.100510 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.wsgi [None req-450f5d27-5dff-4d7e-ab1a-9ad9f47db4e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-450f5d27-5dff-4d7e-ab1a-9ad9f47db4e0 admin admin] Request method failure captured: Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept: application/json Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept-Encoding: gzip, deflate Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Connection: keep-alive Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Content-Length: 0 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Host: 10.222.0.85 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-System-Scope: None Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: User-Agent: python-novaclient Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Auth-Token: gAAAAABjDR-bmI470paMAFgZNgQwh_NoCuA32AlZs921qg7Jum0_Sjqd_2dplncPFELEP-PTlml9BturUCC5OLlllmmEwiwv_xcX8HvZcKSTehUXgty28T7gpVhPW51qlpo8-oPpnKkTg2wF5PMmWed8RJduM_mzBPy5XPd9NTVmmtTRoUgwl0I Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Id: None Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Name: None Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Identity-Status: Confirmed Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Is-Admin-Project: True Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Id: default Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Name: Default Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Name: admin Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Role: reader,admin,member Aug 29 20:20:44.102003 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Roles: reader,admin,member Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant: admin Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Name: admin Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User: admin Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Id: default Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Name: Default Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Name: admin Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: method: > Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: exception: Flavor 84 could not be found. Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: action_args: {'id': '84'} Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.103606 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.104617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.105975 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-450f5d27-5dff-4d7e-ab1a-9ad9f47db4e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.107208 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-450f5d27-5dff-4d7e-ab1a-9ad9f47db4e0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395113 Aug 29 20:20:44.107208 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Mon Aug 29 20:20:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:44.112974 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-2ff3ba7b-4efa-4c5b-85bf-685550981022 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.128414 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-2ff3ba7b-4efa-4c5b-85bf-685550981022 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019034 Aug 29 20:20:44.128950 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:44.138771 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-6ebe4125-d7d6-4483-a72c-412877ed1e75 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.153882 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-6ebe4125-d7d6-4483-a72c-412877ed1e75 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018566 Aug 29 20:20:44.154398 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:44.163604 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-137f6617-6030-4eff-abfb-c7a5e39085fa admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.168861 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.wsgi [None req-137f6617-6030-4eff-abfb-c7a5e39085fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-137f6617-6030-4eff-abfb-c7a5e39085fa admin admin] Request method failure captured: Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept: application/json Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept-Encoding: gzip, deflate Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Connection: keep-alive Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Content-Length: 0 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Host: 10.222.0.85 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-System-Scope: None Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: User-Agent: python-novaclient Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Auth-Token: gAAAAABjDR-bmI470paMAFgZNgQwh_NoCuA32AlZs921qg7Jum0_Sjqd_2dplncPFELEP-PTlml9BturUCC5OLlllmmEwiwv_xcX8HvZcKSTehUXgty28T7gpVhPW51qlpo8-oPpnKkTg2wF5PMmWed8RJduM_mzBPy5XPd9NTVmmtTRoUgwl0I Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Id: None Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Name: None Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Identity-Status: Confirmed Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Is-Admin-Project: True Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Id: default Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Name: Default Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Name: admin Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Role: reader,admin,member Aug 29 20:20:44.170351 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Roles: reader,admin,member Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant: admin Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Name: admin Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User: admin Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Id: default Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Name: Default Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Name: admin Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: method: > Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: exception: Flavor 84 could not be found. Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: action_args: {'id': '84'} Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.171876 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.172894 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.174225 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-137f6617-6030-4eff-abfb-c7a5e39085fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.175542 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-137f6617-6030-4eff-abfb-c7a5e39085fa admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011618 Aug 29 20:20:44.175542 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:45.137839 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-6ebe4125-d7d6-4483-a72c-412877ed1e75 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.138839 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-6ebe4125-d7d6-4483-a72c-412877ed1e75 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 29 20:20:45.139232 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:45.655265 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-820cbe37-98fe-47dd-8566-8b244ecf83bb admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.660974 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.wsgi [None req-820cbe37-98fe-47dd-8566-8b244ecf83bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-820cbe37-98fe-47dd-8566-8b244ecf83bb admin admin] Request method failure captured: Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept: application/json Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Accept-Encoding: gzip, deflate Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Connection: keep-alive Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Content-Length: 0 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Host: 10.222.0.85 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Openstack-System-Scope: None Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: User-Agent: python-novaclient Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Auth-Token: gAAAAABjDR-d2lD2hT6KTGKdzpCiGK_NaNcamjY3zEuqtsGQiJY1Wo7m7IO0d4yA5fxmsC0z7hz9mMvFfxqCH9F4YeW0oZHEwGaMFv8fKF7hDv70SWiSf75QHqkuqN1uxJKAA0v1ZEbDLiynbCXOuWALURvxadJMujRCOD8ibt9GmHNHMnIFRuM Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Id: None Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Domain-Name: None Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Identity-Status: Confirmed Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Is-Admin-Project: True Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Id: default Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Domain-Name: Default Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Project-Name: admin Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Role: reader,admin,member Aug 29 20:20:45.662472 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Roles: reader,admin,member Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant: admin Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-Tenant-Name: admin Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User: admin Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Id: default Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Domain-Name: Default Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: X-User-Name: admin Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: method: > Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: exception: Flavor 451 could not be found. Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: action_args: {'id': '451'} Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:45.664072 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.665579 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.666698 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-820cbe37-98fe-47dd-8566-8b244ecf83bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:45.667896 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-820cbe37-98fe-47dd-8566-8b244ecf83bb admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388340 Aug 29 20:20:45.667896 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:45.676334 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-0ed01d42-5684-4e8a-b2d3-171ccb281815 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.691644 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-0ed01d42-5684-4e8a-b2d3-171ccb281815 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020373 Aug 29 20:20:45.692191 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:45.701704 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.717163 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019032 Aug 29 20:20:45.717724 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:45.726916 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-b55cee0b-2eb0-48fc-ae7a-9c51ea488641 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.732785 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.wsgi [None req-b55cee0b-2eb0-48fc-ae7a-9c51ea488641 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-b55cee0b-2eb0-48fc-ae7a-9c51ea488641 admin admin] Request method failure captured: Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept: application/json Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Accept-Encoding: gzip, deflate Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Connection: keep-alive Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Content-Length: 0 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Host: 10.222.0.85 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-Api-Version: compute 2.90 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Openstack-System-Scope: None Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: User-Agent: python-novaclient Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Auth-Token: gAAAAABjDR-d2lD2hT6KTGKdzpCiGK_NaNcamjY3zEuqtsGQiJY1Wo7m7IO0d4yA5fxmsC0z7hz9mMvFfxqCH9F4YeW0oZHEwGaMFv8fKF7hDv70SWiSf75QHqkuqN1uxJKAA0v1ZEbDLiynbCXOuWALURvxadJMujRCOD8ibt9GmHNHMnIFRuM Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Id: None Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Domain-Name: None Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Identity-Status: Confirmed Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Is-Admin-Project: True Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Id: default Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Domain-Name: Default Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Project-Name: admin Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Role: reader,admin,member Aug 29 20:20:45.734276 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Roles: reader,admin,member Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08700a8f1f34f3488594693a51c7bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08700a8f1f34f3488594693a51c7bb4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant: admin Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Id: e08700a8f1f34f3488594693a51c7bb4 Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-Tenant-Name: admin Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User: admin Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Id: default Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Domain-Name: Default Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Id: 7afd1ca5c60c424cb58374006df79ec1 Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: X-User-Name: admin Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: method: > Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: exception: Flavor 451 could not be found. Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: action_args: {'id': '451'} Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:45.735851 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.737151 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.738433 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-b55cee0b-2eb0-48fc-ae7a-9c51ea488641 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:45.739663 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-b55cee0b-2eb0-48fc-ae7a-9c51ea488641 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012219 Aug 29 20:20:45.739663 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:46.696264 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:46.697269 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 29 20:20:46.697663 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:47.219299 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-6c2fe38d-c05b-49a6-ba7b-7c4bf6d59dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:47.314776 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-6c2fe38d-c05b-49a6-ba7b-7c4bf6d59dfc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.480319 Aug 29 20:20:47.315352 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Mon Aug 29 20:20:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:48.283693 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:48.284767 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 29 20:20:48.285169 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:48.826340 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-6c8d6f02-3997-477d-b770-19028fea178b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:48.915983 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-6c8d6f02-3997-477d-b770-19028fea178b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.491837 Aug 29 20:20:48.916574 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Mon Aug 29 20:20:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:49.878478 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:49.879487 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 29 20:20:49.879888 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:50.405627 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-3cc85425-c585-4d2b-83e3-2fc0c7205b8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:50.521201 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-3cc85425-c585-4d2b-83e3-2fc0c7205b8d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.500343 Aug 29 20:20:50.521687 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Mon Aug 29 20:20:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:51.487045 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.488045 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 29 20:20:51.488474 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:52.003051 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-f6db6dc4-39d6-4acd-b6b1-7fdee6a72cb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:52.086177 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-f6db6dc4-39d6-4acd-b6b1-7fdee6a72cb4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461466 Aug 29 20:20:52.087302 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Mon Aug 29 20:20:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:20:53.067420 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.068769 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 29 20:20:53.069166 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:53.586327 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-70ccef57-b531-4b0a-ba0c-79f3b29d66b6 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.607132 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-70ccef57-b531-4b0a-ba0c-79f3b29d66b6 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398908 Aug 29 20:20:53.611264 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:46.914385 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:46.916003 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-fb22489d-774b-4da5-8516-a59ef24ce180 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Aug 29 20:21:46.916482 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 931 bytes} [Mon Aug 29 20:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:46.927218 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:47.422709 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-f936e539-2228-4f10-a277-bcac733a781d admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.442721 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-f936e539-2228-4f10-a277-bcac733a781d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.520052 Aug 29 20:21:47.443774 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1292 bytes} [Mon Aug 29 20:21:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:21:47.464889 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG dbcounter [-] [106254] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:47.468576 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-a4d15830-4d22-4a50-9521-2af64d7be066 admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.476010 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-a4d15830-4d22-4a50-9521-2af64d7be066 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012552 Aug 29 20:21:47.480446 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1283 bytes} [Mon Aug 29 20:21:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:47.487866 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-bd1a7c6f-958f-409b-ac84-99414a2c063c admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.495353 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-bd1a7c6f-958f-409b-ac84-99414a2c063c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011050 Aug 29 20:21:47.495862 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1286 bytes} [Mon Aug 29 20:21:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:47.507567 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.515431 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011955 Aug 29 20:21:47.515945 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1286 bytes} [Mon Aug 29 20:21:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:47.527712 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-c95087a8-7259-4d01-a73b-4e778ec0a1ac admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.535091 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-c95087a8-7259-4d01-a73b-4e778ec0a1ac admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010836 Aug 29 20:21:47.535623 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1283 bytes} [Mon Aug 29 20:21:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:00.261192 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:00.262199 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 20:25:00.262591 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:00.403221 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_api:SELECT=6 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:00.558337 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:00.562510 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.563012 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.563438 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.564147 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.564614 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.565028 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.598074 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-6c376220-5f89-42a9-b9e6-3891c908292a admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196306 Aug 29 20:25:00.598633 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:25:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:01.425618 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:01.426655 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 29 20:25:01.429313 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:01.617321 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:01.620708 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.621187 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.621617 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:01.622351 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.622785 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.623212 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:01.643808 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-9e0b3d22-097b-4d59-bfaa-a6f46525fb00 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077347 Aug 29 20:25:01.644330 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:25:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:12.873829 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:12.874832 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Aug 29 20:25:12.875264 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:13.027800 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_cell0:SELECT=4 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:13.028814 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_cell1:SELECT=4 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:13.029979 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG dbcounter [-] [106255] Writing DB stats nova_api:SELECT=8 {{(pid=106255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:13.075579 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:13.081381 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.082014 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.082446 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.083243 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:13.083688 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:13.084108 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:13.112447 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-b69a05f8-f528-4c40-805e-9b5f40477461 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091062 Aug 29 20:25:13.113006 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:25:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:25:13.946035 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: DEBUG nova.api.openstack.wsgi [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] Calling method '>' {{(pid=106254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:13.947027 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: INFO nova.api.openstack.requestlog [None req-3684c93e-4266-435b-a65c-eb34844e73bd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 29 20:25:13.947423 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: [pid: 106254|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Mon Aug 29 20:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:14.138136 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG nova.api.openstack.wsgi [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Calling method '>' {{(pid=106255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:14.142265 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:14.142732 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:14.143155 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:14.143858 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:14.144329 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:14.144747 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: DEBUG oslo_concurrency.lockutils [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:14.166308 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: INFO nova.api.openstack.requestlog [None req-9503a5bd-0f64-4fa8-9320-c32afd5cfa4c admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079262 Aug 29 20:25:14.166791 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: [pid: 106255|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Mon Aug 29 20:25:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:11.552960 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: Mon Aug 29 20:26:11 2022 - graceful shutdown triggered... Aug 29 20:26:11.553086 dv-cinder-852009-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 20:26:11.553930 dv-cinder-852009-5-iscsi devstack@n-api.service[106254]: Gracefully killing worker 1 (pid: 106254)... Aug 29 20:26:11.555010 dv-cinder-852009-5-iscsi devstack@n-api.service[106255]: Gracefully killing worker 2 (pid: 106255)... Aug 29 20:26:12.554095 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: worker 1 buried after 1 seconds Aug 29 20:26:12.554519 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: worker 2 buried after 1 seconds Aug 29 20:26:12.554519 dv-cinder-852009-5-iscsi devstack@n-api.service[106253]: goodbye to uWSGI. Aug 29 20:26:12.555701 dv-cinder-852009-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 20:26:12.556269 dv-cinder-852009-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 20:26:12.559131 dv-cinder-852009-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:26:12.569787 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:26:12 2022] *** Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: nodename: dv-cinder-852009-5-iscsi Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: machine: x86_64 Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: clock source: unix Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: pcre jit disabled Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: detected number of CPU cores: 4 Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: current working directory: / Aug 29 20:26:12.572417 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: your processes number limit is 47680 Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: your memory page size is 4096 bytes Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: detected max file descriptor number: 2048 Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: lock engine: pthread robust mutexes Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: thunder lock: enabled Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:26:12.573086 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:26:12.614475 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: Python main interpreter initialized at 0x55c2eacb59c0 Aug 29 20:26:12.614600 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: python threads support enabled Aug 29 20:26:12.614600 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: your server socket listen backlog is limited to 100 connections Aug 29 20:26:12.614600 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:26:12.614859 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:26:12.614943 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: *** Operational MODE: preforking *** Aug 29 20:26:12.615236 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:26:12.615236 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: spawned uWSGI master process (pid: 121450) Aug 29 20:26:12.615435 dv-cinder-852009-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:26:12.616052 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: spawned uWSGI worker 1 (pid: 121467, cores: 1) Aug 29 20:26:12.616478 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: spawned uWSGI worker 2 (pid: 121468, cores: 1) Aug 29 20:26:12.616647 dv-cinder-852009-5-iscsi devstack@n-api.service[121450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:26:13.278982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:26:13.333362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:26:14.440439 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:26:14.440439 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: from cryptography.utils import int_from_bytes Aug 29 20:26:14.441054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:26:14.441054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: from cryptography.utils import int_from_bytes Aug 29 20:26:14.455126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:26:14.455126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: from cryptography.utils import int_from_bytes Aug 29 20:26:14.455627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:26:14.455627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: from cryptography.utils import int_from_bytes Aug 29 20:26:16.827057 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:26:16.827731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:26:16.827925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.838732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-5-iscsi {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.839554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-5-iscsi {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.841856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.842189 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.842509 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.842900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.843273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.843580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.843892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.844418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.844807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.845124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.845429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.845678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.845987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.846315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.846637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.846981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.847214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.847463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.847943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.848302 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.848621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.849098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.849414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.849735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.850081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.850389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.850789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.851100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.851842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.851842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.852133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.852368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.852694 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.853127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.853382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.853690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.854035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.854358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.854668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.854988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.855308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.855617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.855924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.856814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.857139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.857470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.857777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.858031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.858335 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.858640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.859012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.859319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.859681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.859935 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.860262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.864468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:26:16.864910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:26:16.865109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:26:16.865352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865436 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:26:16.865526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:26:16.865730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.865937 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.866914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867092 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.867945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-5-iscsi {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868599 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.868966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869050 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869369 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869548 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869548 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.869936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870820 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.870999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.871610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.872521 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.872622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.872735 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-5-iscsi {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.872888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.872985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873279 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.873807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.874013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.874104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.874321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.874436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.874643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.874824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.874955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.875143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.875268 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.875538 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.875652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.876980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.877134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.877282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.877426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.877426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.877718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.877862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.878009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.878151 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.878304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.878447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.878597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.878750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.878892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.879039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.879491 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.879656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.879770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.879880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.879997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.880107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.880294 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.884334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.884491 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.884648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.884786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.884941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.884941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.885197 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.885331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.885461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.885585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.885722 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.885863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.885991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.886114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.886246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.886400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.886629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.886795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.886945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.887076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.887210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.887363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.887500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.887661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.887661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.887959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.888101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.888311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.888472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.888615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.888756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.888903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.889052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.889194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.889348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.889497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.889638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.889778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.889926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.890073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.890241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.890383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.890541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.890836 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.891251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.891404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.891556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.891556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.891833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.892061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.892239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.892476 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.892649 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.892900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.893073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.893255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.893404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.893570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.893724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.893876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.894020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.894162 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.894310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.894466 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.894616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.894767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.894927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.895070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.895222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.895389 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.895533 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.895689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.895689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.896099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.896277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.896433 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.896576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.896821 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.896979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.897122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.897274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.897416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.897567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.897567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.897567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.897982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.898132 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.898282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.898425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.898572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.898714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.898886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.899048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.899191 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.899340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.899482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.899631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.899772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.899934 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.900094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.900262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.900407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.900576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.900719 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.901420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.901420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.901770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.901917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.902063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.902188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.902307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.902426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.902543 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.902653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.902771 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.902925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.903113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.903238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.903348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.903472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.903590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.903700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.903815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.903931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.904048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.904200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.904318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.904427 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.907368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.907482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.907584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.907691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.907791 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.907888 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.907983 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.908077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.908302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.908483 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.908650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.908840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.908993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.909185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.909373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909464 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.909549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.909724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.909911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.909995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.910107 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.910277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:26:16.910462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.910998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911347 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911803 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.911990 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912511 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.912949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913254 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.913958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914344 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914518 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914694 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.914979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915249 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.915916 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916096 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916265 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916451 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.916979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917845 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.917931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.918471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.919065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.919065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.919220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.919220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.919220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.920650 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.920768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.920847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.920927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921385 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921459 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.921944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.922031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.922105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923243 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923893 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.923985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.924079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.924202 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925361 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925443 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925531 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.925961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.926842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.927975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.928076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.928307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930256 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.930939 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931202 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.931961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932334 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932885 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.932960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.933941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.934065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.934900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.935921 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.936879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937236 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937513 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.937815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938028 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.938912 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939256 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939575 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.939989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.940248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.940397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.940591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.940686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.940918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.941853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942791 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.942897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943722 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.943821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944137 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944367 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.944976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945901 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.945995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.946993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.947326 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.947445 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.947602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.947727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.947840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.948147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.948471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.948935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.949113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.949279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.949453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.949616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.949792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.950446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.950614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.950774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.950926 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951711 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.951895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.952045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.952389 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.952608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.952731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.953047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.953339 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.953516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.953665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.953792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.954902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955483 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955792 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.955913 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.956106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.956260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.956445 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.956682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.956811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.957011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.957132 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.957335 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.957464 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958265 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.958853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.959224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.959432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.959615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.959750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.959750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960608 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.960880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961058 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.961986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.962185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.962393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.962534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.962782 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.962924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.963099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.963418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.963687 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.963830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.964026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.964386 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.964546 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.964689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.967781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.967937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968092 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.968919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.969985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970615 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.970917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.971998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.972795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973628 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.973957 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.974111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.974264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.974514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.974675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.974863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975347 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.975958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.976790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.977872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978330 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.978930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.979186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.979360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.979595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.979595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.979882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980042 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980207 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980518 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.980837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.981549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.981717 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.981908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982722 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.982879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983344 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.983875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984222 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.984988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.985937 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986096 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.986867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.987739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.988873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.989274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.989781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.989781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.990277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.990539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.990766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.990941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.990941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.991240 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.991412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.991566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.991717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.991878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.992990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.993147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.993319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.993472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.993472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.993842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.994891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.995050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.995202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.995915 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.996102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.996102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.996102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.996102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.996807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.997462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.997462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.997462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.997945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998109 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.998744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.999327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.999493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.999493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:16.999808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.000854 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001166 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001785 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.001945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.002891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.003831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.004905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005615 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005615 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.005907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.006209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.006391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.006548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.006708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.006870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.007946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008608 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.008932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009417 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.009892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.010890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011042 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011678 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.011843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012176 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012676 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.012990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.013802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.014172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.014371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.014529 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.014695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.014849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.015000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.015177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.015415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.015415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.015741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016515 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.016994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.017932 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018393 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.018868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019342 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.019980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.020139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.020345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.020568 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.020735 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.020896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021518 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.021976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.022698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.022910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.022910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023839 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.023990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024204 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.024525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.025131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.025283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.025527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.025702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.025702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.026788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.027983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.028187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.028352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.028614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.028791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.028945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.029961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.030113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.030299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.030462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.030462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.030863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.031970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032141 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.032977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.033962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034659 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034659 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.034946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035097 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.035833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036489 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.036937 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.037858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038664 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.038997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039162 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.039939 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.040098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.040326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.040501 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.040662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.040920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041249 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.041874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.042978 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.043139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.043291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.043449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.044140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.044399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.044556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.044708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.044868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045526 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.045927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.046085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.046283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.046283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.046594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.046862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.047948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.048110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.048340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.048500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.048651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.048847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.049954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050737 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.050914 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.051153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.051314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.051487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.051828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.051986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.052146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.052405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.052563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.052563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.052851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053180 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.053968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.054967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.055931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.056203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.056380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.056380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.056680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.056831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.057754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058342 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.058967 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.059159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.059853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060793 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.060953 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.061129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.061372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.061546 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.061709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.061904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.062908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.063210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.064459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.064636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.064801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.064956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.065877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.066198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.066198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.066198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.066751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.066905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.067855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068737 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.068901 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069222 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.069859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.070971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.071134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.071288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.071539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.071699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.071699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072006 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.072973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073606 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.073929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.074971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.075924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.076076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.076269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.076455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.076455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.076850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.077922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.078210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.078376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.078376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.078706 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.078857 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.079643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080563 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.080773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.081091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.081256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.081661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.081834 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.081987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.082892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.083819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.084133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.084390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.084590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.084775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.084957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.085315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.085476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.085629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.085629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.085929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086385 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086544 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086715 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.086949 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.087915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.088726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.089963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.090125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.090285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.090472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.090631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.090867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091493 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.091671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.092998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.093940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.094253 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.094406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.094595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.094810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.094975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095139 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.095935 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.096935 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097179 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.097985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.098937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.099235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.099478 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.099712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.099712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.100071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.100265 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.101829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.102888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.103856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.104029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.104339 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.104501 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.104667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.104884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.105842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.106994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.107194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.107443 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.107611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.107764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.107917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108762 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.108915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.109866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110326 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.110965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111744 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.111905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112491 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.112974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113180 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.113968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114273 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.114966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115756 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.115908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116426 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116598 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.116921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117234 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117386 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.117964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118755 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.118913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119544 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.119861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.120881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.121044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.121196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.121357 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.121509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.121689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.122403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.122639 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.122814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.122970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123607 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.123990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.124150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.124348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.124511 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.124671 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.124840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125515 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.125998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.126999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:26:17.127161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.127161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.127161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.127161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:26:17.127161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:26:17.185916 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO dbcounter [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Registered counter for database nova_api Aug 29 20:26:17.207329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_db.sqlalchemy.engines [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.214876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writer thread running {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.272287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.context [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),103c962f-eb80-4bbe-a755-160f136dba1f(cell1) {{(pid=121467) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:26:17.274519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO dbcounter [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Registered counter for database nova_api Aug 29 20:26:17.276274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:17.276748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:17.278868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:17.279641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:17.280038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:17.282026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:17.284006 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO dbcounter [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Registered counter for database nova_cell0 Aug 29 20:26:17.287994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO dbcounter [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Registered counter for database nova_cell1 Aug 29 20:26:17.295382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_db.sqlalchemy.engines [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.297151 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_db.sqlalchemy.engines [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.298442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_db.sqlalchemy.engines [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.302506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writer thread running {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.304076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writer thread running {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.362015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.context [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),103c962f-eb80-4bbe-a755-160f136dba1f(cell1) {{(pid=121468) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:26:17.365966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:17.366452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:17.368033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:17.368784 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:17.369233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:17.371202 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:17.373238 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO dbcounter [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Registered counter for database nova_cell0 Aug 29 20:26:17.377329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO dbcounter [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Registered counter for database nova_cell1 Aug 29 20:26:17.384591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_db.sqlalchemy.engines [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.386267 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_db.sqlalchemy.engines [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.392693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writer thread running {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.394153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writer thread running {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.443200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writer thread running {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.453124 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO dbcounter [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Registered counter for database nova_cell0 Aug 29 20:26:17.459723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_db.sqlalchemy.engines [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.463958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writer thread running {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.539730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO dbcounter [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Registered counter for database nova_cell0 Aug 29 20:26:17.546960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_db.sqlalchemy.engines [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:26:17.551808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writer thread running {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:26:17.780757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: WARNING keystonemiddleware.auth_token [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:26:17.787983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: WARNING keystonemiddleware.auth_token [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:26:17.872787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: WARNING keystonemiddleware.auth_token [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:26:17.880714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: WARNING keystonemiddleware.auth_token [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:26:18.132111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: WARNING keystonemiddleware.auth_token [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:26:18.139283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: WARNING keystonemiddleware.auth_token [None req-f07c3a8c-2938-4862-8125-7df3bd3dcc06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:26:18.145424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2eacb59c0 pid: 121467 (default app) Aug 29 20:26:18.234519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: WARNING keystonemiddleware.auth_token [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:26:18.240613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: WARNING keystonemiddleware.auth_token [None req-c9e33264-76a6-4f29-a3cc-8599860c2ff5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:26:18.245940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2eacb59c0 pid: 121468 (default app) Aug 29 20:26:54.107040 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:54.110687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:54.110687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:54.110687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:55.285624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae838942-26ba-4127-a991-55cabcb9552f tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Action: 'create', calling method: .version_select at 0x7f89887abe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1068350523", "metadata": {"Type": "work"}}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:55.764627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:55.765460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:55.766680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:55.767857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:57.082016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-522921db-dfaf-4e4c-8113-31a90bded373 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Action: 'create', calling method: .version_select at 0x7f8988769dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-978981694"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:58.439313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ae838942-26ba-4127-a991-55cabcb9552f tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.342020 Aug 29 20:26:58.440672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1156 bytes} [Mon Aug 29 20:26:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4346 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 20:26:58.459332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-16fec128-0efd-4d36-a0ba-9fce7524e130 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f898862dca0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:59.174527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-16fec128-0efd-4d36-a0ba-9fce7524e130 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 200 len: 353 microversion: 2.1 time: 0.722342 Aug 29 20:26:59.175318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 2/2] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:26:58 2022] GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 353 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:59.428103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-522921db-dfaf-4e4c-8113-31a90bded373 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.668745 Aug 29 20:26:59.429667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1155 bytes} [Mon Aug 29 20:26:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 20:26:59.443793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d72f860d-19ac-408b-a52f-c9678237fd87 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89886463a0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:59.634079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d72f860d-19ac-408b-a52f-c9678237fd87 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.193948 Aug 29 20:26:59.641225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 3/4] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:26:59 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:00.189706 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9947c64f-3546-4cc3-83ea-f0ce9310df16 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f89885e1c10>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:00.452318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9947c64f-3546-4cc3-83ea-f0ce9310df16 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 200 len: 354 microversion: 2.1 time: 0.267373 Aug 29 20:27:00.453542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 2/5] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:00 2022] GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:00.473491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6386a8a7-aa2d-4e96-8225-82d53597a56b tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f8988646af0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:00.653981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2f929521-cf92-485c-ac39-d3e52a34a996 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885fb3a0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:00.744296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6386a8a7-aa2d-4e96-8225-82d53597a56b tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 200 len: 354 microversion: 2.1 time: 0.275007 Aug 29 20:27:00.744771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 4/6] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:00 2022] GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 354 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:00.766443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f4bcbde-499b-4a2c-a019-3ae17b991817 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f898862dca0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:00.897469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2f929521-cf92-485c-ac39-d3e52a34a996 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 345 microversion: 2.1 time: 0.251523 Aug 29 20:27:00.898018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 3/7] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:00 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:00.918646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ffc5a936-c097-4305-aee0-ec5aeb9d83d2 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Action: 'create', calling method: .version_select at 0x7f89885fb9d0>, body: {"snapshot": {"volume_id": "1058a2ce-4213-49ed-b8f4-b42af739231a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-822503026"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:01.249271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f4bcbde-499b-4a2c-a019-3ae17b991817 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 202 len: 0 microversion: 2.1 time: 0.487797 Aug 29 20:27:01.250103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 5/8] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:27:00 2022] DELETE /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:27:01.257553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8dcafabe-def8-4c35-bd73-3f3e92857d94 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f8988646b80>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:01.762071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ffc5a936-c097-4305-aee0-ec5aeb9d83d2 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.846654 Aug 29 20:27:01.763582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 4/9] 10.222.0.85 () {60 vars in 1162 bytes} [Mon Aug 29 20:27:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:01.776080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ea5e68ce-7e18-481c-a976-52a717f89d4a tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885fbca0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:01.856834 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8dcafabe-def8-4c35-bd73-3f3e92857d94 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 200 len: 353 microversion: 2.1 time: 0.602489 Aug 29 20:27:01.858507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 6/10] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:01 2022] GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 353 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:01.980668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ea5e68ce-7e18-481c-a976-52a717f89d4a tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 286 microversion: 2.1 time: 0.210509 Aug 29 20:27:01.982102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 5/11] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:01 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:01.993964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-631ba5c5-ae3b-4247-ab32-d1460874676c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988646430>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:02.747142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-631ba5c5-ae3b-4247-ab32-d1460874676c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.757715 Aug 29 20:27:02.750527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 7/12] 10.222.0.85 () {58 vars in 1140 bytes} [Mon Aug 29 20:27:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:02.759018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5bbb3e15-218d-4a1b-804a-b20b73830a1f tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885fb430>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:02.887285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-71deb138-d2e4-4776-a0dc-7eb1a77db094 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Calling method '.version_select at 0x7f89886461f0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:02.953586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5bbb3e15-218d-4a1b-804a-b20b73830a1f tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 286 microversion: 2.1 time: 0.198757 Aug 29 20:27:02.954775 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 6/13] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:02 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:02.975480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-71deb138-d2e4-4776-a0dc-7eb1a77db094 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] HTTP exception thrown: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-71deb138-d2e4-4776-a0dc-7eb1a77db094 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Request method failure captured: Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df HTTP/1.1 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEOAnZJAT8Y1BOcE-mg40bbIsb2sWxYF6ZVF37NY5CluLGqLf27cyOkgu2odWj779Bw1szI5UyGJPifRogZevwD-MhIo1ZhMGj5hTlHxzrdMYeo6yvQnKveIwYT_XQlUdoOm7PM4F0ufsXVYxmRwBWU946pHJ3Eu-6DsjcrwhY-Rfo Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: b01211b781474f90934dafe9263ee0a5 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesGetTestJSON-1941929218 Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:27:02.981201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b01211b781474f90934dafe9263ee0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b01211b781474f90934dafe9263ee0a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b01211b781474f90934dafe9263ee0a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b01211b781474f90934dafe9263ee0a5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesGetTestJSON-1941929218 Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: b01211b781474f90934dafe9263ee0a5 Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesGetTestJSON-1941929218 Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesGetTestJSON-1941929218-project Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: d57d38e5168049c0beb124cbab043a60 Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesGetTestJSON-1941929218-project Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '122b9f60-a01a-4536-98a7-74cef43153df'} Aug 29 20:27:02.982305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. (HTTP 404) (Request-ID: req-630d877c-a1ca-406e-8b06-39bd98d797d3) Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:02.982965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:02.983865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:27:02.984798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-71deb138-d2e4-4776-a0dc-7eb1a77db094 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] Returning 404 to user: Volume 122b9f60-a01a-4536-98a7-74cef43153df could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:02.985795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-71deb138-d2e4-4776-a0dc-7eb1a77db094 tempest-VolumesGetTestJSON-1941929218 tempest-VolumesGetTestJSON-1941929218-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df" status: 404 len: 109 microversion: 2.1 time: 0.114458 Aug 29 20:27:02.992647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 8/14] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:02 2022] GET /compute/v2.1/os-volumes/122b9f60-a01a-4536-98a7-74cef43153df => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:03.967596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d8b2f48b-9cc3-4dc2-ada0-2efd57e1c7eb tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885e1d30>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:04.011782 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d8b2f48b-9cc3-4dc2-ada0-2efd57e1c7eb tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 286 microversion: 2.1 time: 0.043205 Aug 29 20:27:04.011782 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 7/15] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:03 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:05.024818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-93c7baf2-8006-4235-bff4-7dc45f1573a1 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988fba3a0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:05.074759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-93c7baf2-8006-4235-bff4-7dc45f1573a1 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 286 microversion: 2.1 time: 0.058661 Aug 29 20:27:05.090613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 9/16] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:05 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:06.089028 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7fa68a9a-18c5-4cfa-ab05-1800e3040632 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885d14c0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:06.162224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7fa68a9a-18c5-4cfa-ab05-1800e3040632 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 287 microversion: 2.1 time: 0.077192 Aug 29 20:27:06.169413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 10/17] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:06 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:06.174970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0dd66de-670b-4c14-a299-f918690b8c7e tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885d1d30>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:06.421400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b0dd66de-670b-4c14-a299-f918690b8c7e tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 202 len: 0 microversion: 2.1 time: 0.250692 Aug 29 20:27:06.422166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 11/18] 10.222.0.85 () {58 vars in 1254 bytes} [Mon Aug 29 20:27:06 2022] DELETE /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:27:06.428056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684291123", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "networks": [{"uuid": "679a6d3b-b3a3-45dd-aabc-ea3f577fb5f8"}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:06.430522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0f17df01-bed9-45f4-9168-670eae00de3c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885b4430>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:06.515065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0f17df01-bed9-45f4-9168-670eae00de3c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 200 len: 286 microversion: 2.1 time: 0.088353 Aug 29 20:27:06.515766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 12/19] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:06 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:06.719417 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] validate_networks() for [('679a6d3b-b3a3-45dd-aabc-ea3f577fb5f8', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:27:07.528590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c4335d6a-007b-4f08-9a2f-01da7ad80a77 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885b4af0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:07.590695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-c4335d6a-007b-4f08-9a2f-01da7ad80a77 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] HTTP exception thrown: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c4335d6a-007b-4f08-9a2f-01da7ad80a77 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Request method failure captured: Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e HTTP/1.1 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEPYvT12gMdu7QvAvq6bH6mrxgrZOuN0K3_KTcDZxdUF0L1C1HgDu9d5qUqiOTGkeYHPC5OaDVXCh1mImWUuQpUsKCeISYxuH9G3WlTYd-N_rHaA9YF1ezlGJDpjtjJD_NcQu55I89lsLDxDipjhLI-RYUWlnZ3GdDvQT2ftOTJGJA Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:27:07.594001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fab91f53f7d0452189b5977d835ffb24", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 2311207200ea41169272e4097aa85c38 Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'c84a89c2-6d26-415f-87f8-d8b726d3f83e'} Aug 29 20:27:07.595098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. (HTTP 404) (Request-ID: req-8c3e9422-f907-40d2-9b7e-099d84a35de7) Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.595747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:07.596611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 20:27:07.597488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:07.598449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c4335d6a-007b-4f08-9a2f-01da7ad80a77 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Returning 404 to user: Snapshot c84a89c2-6d26-415f-87f8-d8b726d3f83e could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:07.599485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c4335d6a-007b-4f08-9a2f-01da7ad80a77 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e" status: 404 len: 111 microversion: 2.1 time: 0.074866 Aug 29 20:27:07.600158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 13/20] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:27:07 2022] GET /compute/v2.1/os-snapshots/c84a89c2-6d26-415f-87f8-d8b726d3f83e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:27:07.621438 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-cfc7031a-dbb5-475f-8bc9-7ae6f1e83c99 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89885d1280>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:08.030761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-cfc7031a-dbb5-475f-8bc9-7ae6f1e83c99 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 202 len: 0 microversion: 2.1 time: 0.413896 Aug 29 20:27:08.034623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 14/21] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:27:07 2022] DELETE /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:27:08.040421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a58df85c-0076-4b70-a5e8-a00c50f8c93b tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988fba0d0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:08.173324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a58df85c-0076-4b70-a5e8-a00c50f8c93b tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.137069 Aug 29 20:27:08.174114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 15/22] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:08 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:08.820138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:27:08.820642 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:27:08.821151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:27:08.827593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:27:08.828033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:27:08.890028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:08.890028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:08.890028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:08.895324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:08.896107 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:08.896798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:08.982570 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Getting quotas for project 0eaee9c0d7014c88b9b08f4f5e020a66. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:09.020276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Getting quotas for user c823ba2f1a1b441989d27846a43d60ad and project 0eaee9c0d7014c88b9b08f4f5e020a66. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:09.072748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:27:09.076003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:27:09.190246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bfb535f4-e933-4ea5-a0f1-80c25bd445cf tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89886469d0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:09.291801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bfb535f4-e933-4ea5-a0f1-80c25bd445cf tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.105871 Aug 29 20:27:09.293600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 16/23] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:09 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:09.329490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cf4d4c38-4d8b-49c0-80cd-2e2eafaa397a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.491954 Aug 29 20:27:09.332573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 8/24] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:27:09.343327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-52587fcd-3407-4655-9314-456591a2e829 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:09.344141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-52587fcd-3407-4655-9314-456591a2e829 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:09.564249 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-52587fcd-3407-4655-9314-456591a2e829 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:09.631406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-52587fcd-3407-4655-9314-456591a2e829 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1214 microversion: 2.1 time: 0.290575 Aug 29 20:27:09.640311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 17/25] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:09 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:10.211589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-537510398", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:10.307683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c08a5cb8-8cc7-40d1-9acb-b24b59da22fb tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988577ee0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:10.369419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] validate_networks() for [('0b32b458-e224-4b4c-8df7-a9ce6fdf0867', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:27:10.406498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c08a5cb8-8cc7-40d1-9acb-b24b59da22fb tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.102692 Aug 29 20:27:10.407297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 18/26] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:10 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:10.710483 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-67aec2ee-6a1c-4eac-bb95-8bf40e767b60 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: .version_select at 0x7f89885b4280>, body: {"keypair": {"name": "tempest-keypair-170264495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqa1qbj0h7lUAMPIUPdQfP2TaJIrn6mLMGWGb8/EQLubtc93th6GUGHo/e28Rck1FQcABpj0C4ETYTuMBcN5ehQKTR5lBMgSJI7djerA9P95Tp5rTJRE88rX6DplHsbqQ=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:10.761821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-67aec2ee-6a1c-4eac-bb95-8bf40e767b60 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:10.775925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-67aec2ee-6a1c-4eac-bb95-8bf40e767b60 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for user 3f4b05a527e14d2599e03077c6c5f96f and project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:11.005023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-67aec2ee-6a1c-4eac-bb95-8bf40e767b60 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.400108 Aug 29 20:27:11.006433 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 19/27] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:27:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:11.013207 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-67fb960d-f349-476c-96a0-1990b41a563d tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:11.014958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-67fb960d-f349-476c-96a0-1990b41a563d tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:11.110110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-67fb960d-f349-476c-96a0-1990b41a563d tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:11.121516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-67fb960d-f349-476c-96a0-1990b41a563d tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1214 microversion: 2.1 time: 0.113869 Aug 29 20:27:11.124292 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 20/28] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:11 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:11.328505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:27:11.333310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:27:11.333310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:27:11.333310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:27:11.333310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:27:11.343583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:11.344073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:11.344532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:11.345242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:11.345690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:11.346110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:11.367559 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:11.373070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for user 336345e5437341ba9859d776c44ea4be and project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:11.390439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:27:11.392919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:27:11.432614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7420a626-8c94-45bf-883b-9021a48827ec tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988587940>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:11.559991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c7fa82a9-ab0b-4c98-95af-ca1a1230e4b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.853670 Aug 29 20:27:11.570897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 9/29] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:27:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:27:11.585455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3f867ce0-6e3e-4f1d-beea-08aafc238ec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:11.595379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3f867ce0-6e3e-4f1d-beea-08aafc238ec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:11.597873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7420a626-8c94-45bf-883b-9021a48827ec tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.176851 Aug 29 20:27:11.598460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 21/30] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:11 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:11.859896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3f867ce0-6e3e-4f1d-beea-08aafc238ec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:11.906531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3f867ce0-6e3e-4f1d-beea-08aafc238ec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1221 microversion: 2.1 time: 0.334197 Aug 29 20:27:11.909952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 10/31] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:11 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1221 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:12.146661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2a95e586-ef34-4fb8-ad42-6fc293c2d539 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:12.147958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2a95e586-ef34-4fb8-ad42-6fc293c2d539 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:12.414974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2a95e586-ef34-4fb8-ad42-6fc293c2d539 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:12.431773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2a95e586-ef34-4fb8-ad42-6fc293c2d539 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1214 microversion: 2.1 time: 0.289527 Aug 29 20:27:12.435891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 22/32] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:12 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:12.477592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1358108218", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:12.611446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-466b228d-b9bb-4d2c-a96f-08764b628f6e tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89884efe50>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:12.616809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] validate_networks() for [('0b32b458-e224-4b4c-8df7-a9ce6fdf0867', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:27:12.743460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-466b228d-b9bb-4d2c-a96f-08764b628f6e tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.135966 Aug 29 20:27:12.744451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 23/33] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:12 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:13.456753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:13.457688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:13.466334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:13.472985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:13.473686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:13.474610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:13.475247 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:13.476798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:27:13.477231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:27:13.477710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:27:13.478281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:27:13.478801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:13.479512 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:27:13.496636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:13.516296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:13.521479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:13.522469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:13.523108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:13.523695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:13.583128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:13.592254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for user 336345e5437341ba9859d776c44ea4be and project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:13.640797 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:27:13.644390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:27:13.759314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:13.785538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ffe52f73-f6bd-4066-bbb7-d0f17c73657e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1218 microversion: 2.1 time: 0.333258 Aug 29 20:27:13.787325 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 24/34] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:13 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1218 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:13.831055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-62c260e9-29d3-4180-9e33-50220439ebef tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988481e50>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:13.872766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-151e3afe-37bd-4c86-a06c-37e1c88d7f31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.397829 Aug 29 20:27:13.879663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 11/35] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:27:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:27:13.886469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-65ec6fb0-83fd-4f73-91d7-e89e9cb10f32 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:13.887230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-65ec6fb0-83fd-4f73-91d7-e89e9cb10f32 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:13.973190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-65ec6fb0-83fd-4f73-91d7-e89e9cb10f32 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:13.985763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-65ec6fb0-83fd-4f73-91d7-e89e9cb10f32 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1222 microversion: 2.1 time: 0.103260 Aug 29 20:27:13.986428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 12/36] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:13 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:14.002191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-62c260e9-29d3-4180-9e33-50220439ebef tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 200 len: 344 microversion: 2.1 time: 0.213588 Aug 29 20:27:14.003580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 25/37] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:13 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:14.817088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:14.818362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:14.830418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:14.831297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:14.832123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:14.833638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:14.834590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:14.835531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.009820 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2d40479c-c923-49b9-a014-48a7bd7a558f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.013184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2d40479c-c923-49b9-a014-48a7bd7a558f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:15.149698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:15.162850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e0ca7d31-eea6-4ed2-8000-661f19696535 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1266 microversion: 2.1 time: 0.359369 Aug 29 20:27:15.163424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 13/38] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:14 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:15.169581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ccf3a7df-ca1c-4ebe-b101-735e6e755ff3 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8987c3d8b0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.211983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2d40479c-c923-49b9-a014-48a7bd7a558f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:15.218321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-ccf3a7df-ca1c-4ebe-b101-735e6e755ff3 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] HTTP exception thrown: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.219104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2d40479c-c923-49b9-a014-48a7bd7a558f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1222 microversion: 2.1 time: 0.213410 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ccf3a7df-ca1c-4ebe-b101-735e6e755ff3 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Request method failure captured: Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a HTTP/1.1 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEPYvT12gMdu7QvAvq6bH6mrxgrZOuN0K3_KTcDZxdUF0L1C1HgDu9d5qUqiOTGkeYHPC5OaDVXCh1mImWUuQpUsKCeISYxuH9G3WlTYd-N_rHaA9YF1ezlGJDpjtjJD_NcQu55I89lsLDxDipjhLI-RYUWlnZ3GdDvQT2ftOTJGJA Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:27:15.224429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fab91f53f7d0452189b5977d835ffb24", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 2311207200ea41169272e4097aa85c38 Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '1058a2ce-4213-49ed-b8f4-b42af739231a'} Aug 29 20:27:15.225508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. (HTTP 404) (Request-ID: req-4785712a-0ccb-4763-8b94-cba22a814507) Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.226152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:15.227571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:27:15.228571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ccf3a7df-ca1c-4ebe-b101-735e6e755ff3 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Returning 404 to user: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ccf3a7df-ca1c-4ebe-b101-735e6e755ff3 tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 404 len: 109 microversion: 2.1 time: 0.061635 Aug 29 20:27:15.229577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 14/39] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:15 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:15.236473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 26/40] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:15 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:15.267131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bff32812-5de8-461d-b202-0dce649a9dff tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f8988faef70>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.409383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-bff32812-5de8-461d-b202-0dce649a9dff tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] HTTP exception thrown: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bff32812-5de8-461d-b202-0dce649a9dff tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Request method failure captured: Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a HTTP/1.1 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEPYvT12gMdu7QvAvq6bH6mrxgrZOuN0K3_KTcDZxdUF0L1C1HgDu9d5qUqiOTGkeYHPC5OaDVXCh1mImWUuQpUsKCeISYxuH9G3WlTYd-N_rHaA9YF1ezlGJDpjtjJD_NcQu55I89lsLDxDipjhLI-RYUWlnZ3GdDvQT2ftOTJGJA Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:27:15.410403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fab91f53f7d0452189b5977d835ffb24", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 2311207200ea41169272e4097aa85c38 Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '1058a2ce-4213-49ed-b8f4-b42af739231a'} Aug 29 20:27:15.411718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. (HTTP 404) (Request-ID: req-63842132-eb57-481c-ac17-a519284fdf96) Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.412400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:27:15.413454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:27:15.414345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bff32812-5de8-461d-b202-0dce649a9dff tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Returning 404 to user: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bff32812-5de8-461d-b202-0dce649a9dff tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 404 len: 109 microversion: 2.1 time: 0.165123 Aug 29 20:27:15.415221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 15/41] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:27:15 2022] DELETE /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:15.422079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-db71cb15-2f38-4303-b43d-4850200f1c4c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Calling method '.version_select at 0x7f89884ef670>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-db71cb15-2f38-4303-b43d-4850200f1c4c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] HTTP exception thrown: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-db71cb15-2f38-4303-b43d-4850200f1c4c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Request method failure captured: Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a HTTP/1.1 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEPYvT12gMdu7QvAvq6bH6mrxgrZOuN0K3_KTcDZxdUF0L1C1HgDu9d5qUqiOTGkeYHPC5OaDVXCh1mImWUuQpUsKCeISYxuH9G3WlTYd-N_rHaA9YF1ezlGJDpjtjJD_NcQu55I89lsLDxDipjhLI-RYUWlnZ3GdDvQT2ftOTJGJA Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:27:15.502337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fab91f53f7d0452189b5977d835ffb24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fab91f53f7d0452189b5977d835ffb24", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: fab91f53f7d0452189b5977d835ffb24 Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-775523374 Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 2311207200ea41169272e4097aa85c38 Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-775523374-project Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '1058a2ce-4213-49ed-b8f4-b42af739231a'} Aug 29 20:27:15.503709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. (HTTP 404) (Request-ID: req-cd98df8a-b551-4f2d-b0a0-4631b9a314c1) Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.504741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:27:15.506258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:27:15.508744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-db71cb15-2f38-4303-b43d-4850200f1c4c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] Returning 404 to user: Volume 1058a2ce-4213-49ed-b8f4-b42af739231a could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-db71cb15-2f38-4303-b43d-4850200f1c4c tempest-VolumesSnapshotsTestJSON-775523374 tempest-VolumesSnapshotsTestJSON-775523374-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a" status: 404 len: 109 microversion: 2.1 time: 0.081574 Aug 29 20:27:15.511491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 27/42] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:27:15 2022] GET /compute/v2.1/os-volumes/1058a2ce-4213-49ed-b8f4-b42af739231a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:16.190567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:16.191192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:16.202402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.202906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.203326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.204041 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.204543 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.204974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.250441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:16.251205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:16.266278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.269517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.272829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.273928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.276774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.278327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.393356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:16.412797 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5c60927e-7c33-461a-b9aa-d528f1100234 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1272 microversion: 2.1 time: 0.224618 Aug 29 20:27:16.419432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 16/43] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:16 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:16.453453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:16.465175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d1871143-221e-4739-87f3-6ced39bba9b4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1218 microversion: 2.1 time: 0.217808 Aug 29 20:27:16.468196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 28/44] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:16 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:16.814173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1524866480", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5109f79e-871b-4557-9678-62a9f5c0649c"}], "security_groups": [{"name": "tempest-securitygroup--51090404"}], "key_name": "tempest-keypair-170264495", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:17.443743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:17.445444 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:17.459583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.469287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.470084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.473449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.478064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.480282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.564106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] validate_networks() for [('5109f79e-871b-4557-9678-62a9f5c0649c', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:27:17.833269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:17.855962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-38e1e389-9fee-4364-b4e3-5f9b51653c38 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1272 microversion: 2.1 time: 0.416992 Aug 29 20:27:17.871172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 29/45] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:17 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1272 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:17.880570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:17.881489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:17.913841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.914723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.919770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.919770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.921855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.923063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:18.106407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:18.119207 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3fc49d25-a7c4-4e13-9d7a-bc3b261c6c8e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1292 microversion: 2.1 time: 0.246708 Aug 29 20:27:18.119976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 30/46] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:17 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1292 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:18.899073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:18.899780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:18.908466 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:18.909068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:18.909588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:18.910352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:18.910912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:18.911379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.043527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:19.055505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3d47e34c-6d33-4f32-9961-8a22aa734191 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1272 microversion: 2.1 time: 0.160177 Aug 29 20:27:19.056720 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 31/47] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:18 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:19.151290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:19.151895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:19.159631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.160130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.160598 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.161302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.161762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.162191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.307670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:19.320969 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7019dfaf-cab0-46e6-adc9-9c07871bac8c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1280 microversion: 2.1 time: 0.173425 Aug 29 20:27:19.322308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 32/48] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:19 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:19.539011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:27:19.540039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:27:19.540764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:27:19.541380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:27:19.542095 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:27:19.554647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.555456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.555990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.556819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.557524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.558194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.578315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:19.590811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for user 3f4b05a527e14d2599e03077c6c5f96f and project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:19.610310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:27:19.615489 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:27:20.077318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:20.077874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:20.083800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:20.084318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:20.084753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:20.085428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:20.085877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:20.086298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:20.154644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:20.163079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7ea2b053-1bad-4608-b9d5-7896f18d77a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1272 microversion: 2.1 time: 0.089579 Aug 29 20:27:20.163982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 33/49] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:20 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:20.345189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:20.351180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:20.351949 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:20.352480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:20.352925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:20.353631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:20.354200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:20.354636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:20.487128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:20.497748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a9e354e2-7393-425f-b0b6-49862a5d967b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1280 microversion: 2.1 time: 0.155324 Aug 29 20:27:20.498956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 34/50] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:20 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:20.572888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-084177d0-6848-4cfa-94bc-fb514388e16c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.767077 Aug 29 20:27:20.574188 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 17/51] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:27:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 3769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:27:20.586900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-28130cf8-7048-457d-b5a9-b1d99598d8b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:20.586900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-28130cf8-7048-457d-b5a9-b1d99598d8b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:20.845213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-28130cf8-7048-457d-b5a9-b1d99598d8b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:20.855824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-28130cf8-7048-457d-b5a9-b1d99598d8b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1237 microversion: 2.1 time: 0.271184 Aug 29 20:27:20.872150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 35/52] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:20 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1237 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:21.188547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:21.189234 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:21.206916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:21.207491 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:21.207980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:21.208780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:21.209203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:21.217029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:21.520430 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:21.521829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:21.539642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:21.542406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:21.543744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:21.545833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:21.547307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:21.549616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:21.763252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:21.780686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-42545adf-cb4c-470b-a1bc-81352922bf53 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1280 microversion: 2.1 time: 0.265411 Aug 29 20:27:21.786034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 36/53] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:21 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:21.879279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e2740689-770b-4301-91da-03cd63fe7a7b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:21.879279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e2740689-770b-4301-91da-03cd63fe7a7b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:21.981258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e2740689-770b-4301-91da-03cd63fe7a7b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:22.009290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e2740689-770b-4301-91da-03cd63fe7a7b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1237 microversion: 2.1 time: 0.138703 Aug 29 20:27:22.019035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 37/54] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:21 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:22.104685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:22.124478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1ff50f31-785a-49c3-bb3e-4949697bf17c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.941579 Aug 29 20:27:22.127579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 18/55] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:21 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:22.809015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:22.811973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:22.825503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:22.826309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:22.826942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:22.827861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:22.828545 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:22.829284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:23.040687 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:23.041560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:23.054682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:23.054682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:23.054682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:23.054682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:23.059366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:23.064014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:23.231789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:23.257274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f80e2485-f46c-422e-a9fc-a6f69966edc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.452986 Aug 29 20:27:23.258541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 38/56] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:22 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:23.263621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:23.264245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:23.270854 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:23.271683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:23.272356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:23.273306 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:23.273934 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:23.274527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:23.495097 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:23.507079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0797aa48-ec63-415e-adc6-a3b56365f83e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.247172 Aug 29 20:27:23.507967 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 39/57] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:23 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:23.857894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:23.866847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ff219d20-1755-4b57-b711-a398304c1df5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1241 microversion: 2.1 time: 0.829701 Aug 29 20:27:23.880541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 19/58] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:23 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1241 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:24.280248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:24.280853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:24.294620 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.301703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.307131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:24.309005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.310111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.311327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:24.534524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:24.535360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:24.544083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.546738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.546738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:24.546738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.546738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.548652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:24.666978 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:24.677107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4bd84c7b-6f1e-44e6-b579-6ba14c6cc152 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.400601 Aug 29 20:27:24.679424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 40/59] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:24 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:24.893926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:24.901066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:24.918399 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.920358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.921191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:24.922041 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:24.922628 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:24.923355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:25.022061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:25.036718 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c73429e3-fcfc-4039-8bf9-5c2fbfdea88e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1289 microversion: 2.1 time: 0.148291 Aug 29 20:27:25.041100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 41/60] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:24 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1289 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:25.237831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:25.250225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0da4c891-0874-4c73-a4ce-6443af33f4aa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.721303 Aug 29 20:27:25.268936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 20/61] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:24 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:25.704689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:25.706244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:25.716797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:25.717602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:25.718314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:25.719541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:25.720225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:25.721079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:26.060873 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:26.061874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:26.075516 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:26.083327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:26.083962 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:26.086731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:26.092644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:26.094547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:26.207925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:26.225400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1d27491c-4a7b-4a6e-a4ed-bc3c37a126fb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.527739 Aug 29 20:27:26.226134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 42/62] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:25 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:26.271985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:26.272683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:26.280704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:26.281196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:26.281633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:26.282335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:26.282787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:26.291455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:26.393455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:26.415539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-53f60793-68d2-46d5-a9f7-4e933d2acc94 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1307 microversion: 2.1 time: 0.358476 Aug 29 20:27:26.417971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 21/63] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:26 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1307 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:26.816186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:26.829854 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-41861489-3c52-423d-b637-8cd8fd07d5ce tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.561606 Aug 29 20:27:26.830732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 43/64] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:26 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:27.249084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:27.249910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:27.263530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.264275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.266711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.267890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.269535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.270678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.438548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:27.439160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:27.462007 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.462494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.467387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.473256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.478749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.478749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.688508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:27.699808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bdf834bf-2dce-46c5-813c-5919b1a56737 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1295 microversion: 2.1 time: 0.265681 Aug 29 20:27:27.725142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 44/65] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:27 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1295 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:27.852958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:27.854387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:27.867748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.869648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.871623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.875370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:27.876750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:27.878449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:27.936486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:28.251886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:28.260822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0e2bc5fe-376a-4841-99b8-368ffd57a0c1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.413092 Aug 29 20:27:28.279003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 45/66] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:27 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:28.608506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:28.617044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c2416121-5f1c-41dd-bd18-34ffdb5da058 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 1.373127 Aug 29 20:27:28.633218 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 22/67] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:27 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:28.741964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:28.743171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:28.754398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:28.755216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:28.757572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:28.758597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:28.763282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:28.763833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:28.827895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61abe1ad-59b4-43ae-9922-b7ec7820a7b6", "tag": "4e4b5b30-5bc4-4141-962d-67cc0c57eb5b"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:28.903575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:28.903575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:28.903575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:28.903575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Creating event network-changed:4e4b5b30-5bc4-4141-962d-67cc0c57eb5b for instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 on hv-cinder-85200 Aug 29 20:27:28.903575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:27:28.905631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6be7f279-259e-41bf-88cf-c443245605ac req-04bc77cf-255d-4fe0-93d7-905f58a0f8e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:27:28.905631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:28.905631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:28.905631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:28.905631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:28.906068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:28.906068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:28.906068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.compute.rpcapi [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:27:28.906857 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] Releasing lock "compute-rpcapi-router" {{(pid=121467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:27:28.949227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0a359bf5-9a67-4810-926e-e444afac4a33 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544442 Aug 29 20:27:28.970428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 46/68] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:29.040291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:29.054327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7428f895-cff1-4311-a460-85c2b2c8093f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1295 microversion: 2.1 time: 0.316739 Aug 29 20:27:29.068703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 23/69] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:28 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1295 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:29.285064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:29.285780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:29.293155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:29.293983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:29.294616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:29.295514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:29.296186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:29.296971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:29.495799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:29.503738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f6e56824-95ff-488f-8e75-b30a3e5232c3 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.223178 Aug 29 20:27:29.504345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 47/70] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:29 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:29.648052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:29.648903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:29.651309 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=8 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:29.652142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=28 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:29.657637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:29.658207 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:29.658655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:29.659384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:29.659880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:29.660405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:29.840907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:29.849221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f80d6a81-f99f-4f81-a674-72697a8f3e49 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.205719 Aug 29 20:27:29.849796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 24/71] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:29 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:30.075975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:30.076562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:30.082550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.083033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.084538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.085341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.085818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.086251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.153557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:30.161130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-57fd926a-086e-45ed-a3f9-ebe221751126 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1295 microversion: 2.1 time: 0.089500 Aug 29 20:27:30.161700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 48/72] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:30 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:30.525341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:30.526222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:30.548434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.549193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.552150 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.553084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.553614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.553990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.858773 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:30.866984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3df5db8c-d78e-4e15-91dd-23191778a917 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.345477 Aug 29 20:27:30.867617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 25/73] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:30 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:30.879112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:30.880705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:30.887330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.887818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.888344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.889038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:30.889491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:30.889918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:30.993217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87805c1d-b091-4831-92e8-6aea8583a106", "tag": "1de6b5ac-8354-472a-992f-46151d073a06"}, {"name": "network-changed", "server_uuid": "ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6", "tag": "355949a2-ff90-4219-bf66-26b294916862"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:31.006588 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.007066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.007492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.046374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:31.056784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fba79001-24d2-4bba-bd17-b047be7bd03b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.182072 Aug 29 20:27:31.058841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 49/74] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:30 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:31.062358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Creating event network-changed:1de6b5ac-8354-472a-992f-46151d073a06 for instance 87805c1d-b091-4831-92e8-6aea8583a106 on hv-cinder-85200 Aug 29 20:27:31.063094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Creating event network-changed:355949a2-ff90-4219-bf66-26b294916862 for instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 on hv-cinder-85200 Aug 29 20:27:31.063788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121468) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:27:31.064399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-197ea958-0008-41f5-b24b-f8cc640df140 req-aef879ae-04c8-4edc-81a8-f410baf0e733 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121468) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:27:31.065580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.066207 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.066778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.067631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.068268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.068852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.079436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.compute.rpcapi [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:27:31.080857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] Releasing lock "compute-rpcapi-router" {{(pid=121468) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:27:31.108735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bf8daeaa-9b84-4835-b9d8-488d392aa949 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113575 Aug 29 20:27:31.108735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 26/75] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:31.184576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:31.185203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:31.191065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.191553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.191989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.192711 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.193176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.193955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.426603 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:31.444662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ecb3490e-04e8-4914-83dd-20a0094ee31e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.264376 Aug 29 20:27:31.446501 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 50/76] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:31 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:31.889512 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:31.890403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:31.898036 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.898557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.899051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:31.899988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:31.900666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:31.901232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:32.079020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:32.079765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:32.081830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=16 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:32.086690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:32.087257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:32.087769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:32.088952 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:32.089480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:32.089982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:32.102697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:32.110549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dcdc9609-0380-43ec-98b2-cdd698a1e6e8 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.226075 Aug 29 20:27:32.111140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 27/77] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:31 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:32.228214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:32.236987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a4b5a350-5959-4c1b-b735-f0c45e10ea56 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.161722 Aug 29 20:27:32.238037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 51/78] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:32 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:32.466946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:32.467835 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:32.482311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:32.482311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:32.482311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:32.482311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:32.483021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:32.483021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:32.483021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:32.611850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:32.619805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b7f8d95c-f4f4-4d9d-b7e7-89f630e16344 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.157301 Aug 29 20:27:32.621096 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 28/79] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:32 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:33.133908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:33.134369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:33.140848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.141382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.141821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.142784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.143238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.143662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.189193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cc3eff-660a-4cdb-93ec-9c5083607486", "tag": "f5ff56a2-aee4-446c-bcb9-f9ea4afb3168"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:33.212334 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.213899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.214518 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.242632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] Creating event network-changed:f5ff56a2-aee4-446c-bcb9-f9ea4afb3168 for instance 01cc3eff-660a-4cdb-93ec-9c5083607486 on hv-cinder-85200 Aug 29 20:27:33.253677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-6d210924-5911-449c-a9a2-6898eac41de6 req-91feeb2b-e06f-47e9-9ad5-3416348fb6d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072810 Aug 29 20:27:33.254283 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 29/80] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:33.266790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:33.266790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:33.283062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.283658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.284398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.285523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.286196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.286879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.327138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:33.338303 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-76db28e6-2d07-45d8-9100-71aae991c485 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.208243 Aug 29 20:27:33.341214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 52/81] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:33 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:33.641699 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:33.643169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:33.649199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.649761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.650310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.651072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:33.652018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:33.652629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:33.818463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:33.826919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e0ed2eb1-ffd2-4c8e-96cf-5ee5c65ea68d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.189003 Aug 29 20:27:33.839942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 53/82] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:33 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:33.989720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:33.997392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-753419c3-9aa8-46f7-9fc7-8bbf47ceb73d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.738081 Aug 29 20:27:33.998009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 30/83] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:33 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:34.363691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:34.364434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:34.372307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:34.372916 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:34.373416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:34.374183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:34.374645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:34.375068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:34.555827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:34.568676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-20e0343b-9075-4936-8162-c6fa1d1fb36c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.208920 Aug 29 20:27:34.569442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 54/84] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:34 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:34.847224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:34.848657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:34.855449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:34.855925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:34.856383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:34.860015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:34.860015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:34.860015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:35.018910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:35.019595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:35.021987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:35.027112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:35.027680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:35.028126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:35.028940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:35.029422 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:35.029925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:35.068896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:35.077388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-94c8b108-757e-4c44-8966-9953738f1967 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.234252 Aug 29 20:27:35.077991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 31/85] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:34 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:35.177355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:35.186155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-97c439f9-fbdc-4045-a664-2e38881b0ef0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.171443 Aug 29 20:27:35.186759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 55/86] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:35 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:35.593877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:35.594897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:35.615679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:35.616257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:35.616702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:35.617418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:35.617875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:35.618299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:35.642648 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:35.855034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:35.864949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9c5303ad-9d99-4a97-9175-3443fad2b40e tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.276013 Aug 29 20:27:35.865765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 32/87] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:35 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:36.099761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:36.100601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:36.108625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.109199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.109713 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:36.110488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.110949 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.111374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:36.207343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:36.207955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:36.214937 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.215748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.216366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:36.217388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.218151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.218739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:36.328457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:36.338398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bba0cf0d-2feb-4406-b1e5-9ac816a351c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.244195 Aug 29 20:27:36.340217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 56/88] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:36 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:36.447678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:36.456007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f29f7ebd-a3a5-4a93-8b71-44732f3bba60 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.252711 Aug 29 20:27:36.457946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 33/89] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:36 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:36.886295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:36.886919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:36.895791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.896314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.896757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:36.897471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:36.897929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:36.898356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:37.079650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:37.089938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6bd3c3f1-eaec-439e-8ed7-ca28eadc25f4 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.207394 Aug 29 20:27:37.091524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 57/90] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:36 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:37.368751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:37.370004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:37.379144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:37.379719 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:37.381268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:37.381268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:37.381484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:37.382951 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:37.485634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:37.486252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:37.492964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:37.493448 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:37.493880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:37.494746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:37.495330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:37.495757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:37.561296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:37.569733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-444d7f47-d7b1-4017-9593-60c2d6b8c17d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.208785 Aug 29 20:27:37.570512 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 34/91] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:37.662389 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:37.670264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5f90668c-6772-40bc-90f1-37233a34914a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.189231 Aug 29 20:27:37.670812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 58/92] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:38.113504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.114374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:38.122403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.123142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.123660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.124777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.125344 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.127444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.313796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:38.328204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8bdadf30-b99f-4560-919d-9375b94de479 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.220393 Aug 29 20:27:38.336558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 35/93] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:38 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:38.598909 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.600554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:38.617264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.617264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.617591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.618316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.618779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.619417 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.690717 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.692061 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:38.706500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.707331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.707972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.708936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:38.709555 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:38.710039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:38.786961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:38.796627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-69affee4-ef09-44e7-86d3-ac283a5ecbc8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.205853 Aug 29 20:27:38.797806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 59/94] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:38 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:39.052597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:39.061133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5d9bf331-f5b1-4123-b963-d0431d51f24c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.374167 Aug 29 20:27:39.062109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 36/95] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:38 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:39.356902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:39.357816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:39.363980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:39.366324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:39.367027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:39.368107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:39.369039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:39.370034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:39.370863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:39.529622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:39.538869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-88121aee-3b83-4826-9be2-9306852fd80b tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.189635 Aug 29 20:27:39.539437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 60/96] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:39 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:39.836867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:39.839317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:39.849269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:39.849936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:39.850526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:39.851473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:39.852032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:39.852691 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:39.991583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:40.001510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b7ad7324-93b1-4299-bfaa-00deb29048e4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.181176 Aug 29 20:27:40.018860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 37/97] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:39 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:40.083532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:40.084994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:40.095503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:40.096451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:40.097045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:40.097931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:40.098640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:40.099276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:40.289417 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:40.303278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4cf8ecce-fdb2-440c-9b8d-5e9f8138ef99 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.223516 Aug 29 20:27:40.305159 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 61/98] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:40 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:40.562662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:40.564242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:40.575815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:40.577321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:40.578393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:40.580249 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:40.592424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:40.593493 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:40.806788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:40.816642 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-11a9289e-a853-4dc2-bd7c-11cfea2b22fd tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.260504 Aug 29 20:27:40.820322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 38/99] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:40 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:41.031771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:41.032516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:41.038684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.039225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.044359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:41.044359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.044359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.044359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:41.065500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:41.214947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:41.236454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ddd181c5-2d5c-4b32-baa6-2b9b16468c4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.209078 Aug 29 20:27:41.237333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 62/100] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:41 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:41.333010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:41.333612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:41.357018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.357018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.357018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:41.357018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.357525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.357525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:41.480743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:41.488468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-89eaf9f6-ab92-415f-809a-47cb1d5dc019 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.159668 Aug 29 20:27:41.489044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 39/101] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:41 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:41.841665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:41.842738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:41.851172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.851689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.852482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:41.853362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:41.853815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:41.854494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:42.009620 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:42.017626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-69ebc553-7389-44df-b985-dcd168caf7d1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.181952 Aug 29 20:27:42.018238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 63/102] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:41 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:42.257960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:42.258578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:42.260634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:42.265450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:42.265938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:42.267615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:42.267615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:42.267848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:42.268626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:42.427891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:42.435873 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dc5cb7c5-8125-416d-a76b-4aa31e091ad8 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.181746 Aug 29 20:27:42.436475 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 40/103] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:42 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:42.509917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:42.510610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:42.519522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:42.519906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:42.520394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:42.521118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:42.521567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:42.521984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:42.662462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:42.671138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a1e87240-1ddf-4e58-b7b2-cde310376ea7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.165648 Aug 29 20:27:42.671724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 64/104] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:42 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:43.040138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:43.041014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:43.049375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.050210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.050710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.051783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.052443 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.052871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.216900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:43.226336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ae3a0730-7449-4aef-9ad5-35cd99804654 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.191397 Aug 29 20:27:43.226928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 41/105] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:43 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:43.456729 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:43.457461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:43.463463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.463948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.464422 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.465104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.465556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.465975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.611564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:43.630194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e1f7601-1780-4415-b5ec-44412a6eaef5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.169535 Aug 29 20:27:43.630194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 65/106] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:43 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:43.707697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:43.713749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:43.727192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.727956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.728608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.730139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.730910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.733885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.814282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87805c1d-b091-4831-92e8-6aea8583a106", "name": "network-vif-plugged", "status": "completed", "tag": "1de6b5ac-8354-472a-992f-46151d073a06"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:43.824973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:43.825758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:43.826597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:43.840651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] Creating event network-vif-plugged:1de6b5ac-8354-472a-992f-46151d073a06 for instance 87805c1d-b091-4831-92e8-6aea8583a106 on hv-cinder-85200 Aug 29 20:27:43.845867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-ea009e01-27e1-45ee-9ef5-558a92825959 req-3cc2979e-c883-4b1f-972d-276e835857ec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092933 Aug 29 20:27:43.848082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 66/107] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:43.907460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:43.917984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1f97ac34-9501-4ade-a7b0-b9b720f82eea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.224323 Aug 29 20:27:43.918583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 42/108] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:43 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:44.247819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:44.248552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:44.255858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.256328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.256765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:44.257801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.258376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.258794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:44.423723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:44.432512 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bc983dcc-5e1a-4421-aacf-99fbfb5ef271 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.189263 Aug 29 20:27:44.440606 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 67/109] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:44 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:44.645213 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:44.645839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:44.663936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.664499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.665089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:44.665944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.666575 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.667258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:44.854080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:44.863500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c2f89994-b610-45ed-8208-6040c7592e95 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.223321 Aug 29 20:27:44.865651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 43/110] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:44 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:44.944972 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:44.948861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:44.962899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.964906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.965510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:44.968420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:44.972309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:44.972962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:45.128541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:45.137146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-77621c67-de59-408a-8745-913a98e03888 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.200324 Aug 29 20:27:45.137650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 68/111] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:44 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:45.454940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:45.461634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:45.462597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:45.463106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:45.463583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:45.464340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:45.464827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:45.465280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:45.641193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:45.649533 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5da63402-198f-44a4-abc4-020cabd97a68 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.198706 Aug 29 20:27:45.650635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 44/112] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:45 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:45.861274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abe1ad-59b4-43ae-9922-b7ec7820a7b6", "name": "network-vif-plugged", "status": "completed", "tag": "4e4b5b30-5bc4-4141-962d-67cc0c57eb5b"}, {"server_uuid": "ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6", "name": "network-vif-plugged", "status": "completed", "tag": "355949a2-ff90-4219-bf66-26b294916862"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:45.871406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:45.871874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:45.872329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:45.884185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:45.885063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Creating event network-vif-plugged:4e4b5b30-5bc4-4141-962d-67cc0c57eb5b for instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 on hv-cinder-85200 Aug 29 20:27:45.885181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:45.886112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] Creating event network-vif-plugged:355949a2-ff90-4219-bf66-26b294916862 for instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 on hv-cinder-85200 Aug 29 20:27:45.891625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:45.892079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:45.892847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:45.893141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6d648e63-633f-4bc2-b63e-463013f6a741 req-68f44fdf-7409-4a07-97a9-19de775ee1fe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035640 Aug 29 20:27:45.893539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:45.893995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 69/113] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:45.894101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:45.894408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:46.059212 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:46.071996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-89032c8d-4886-43e8-a3cd-cc0cdbefe85d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.191609 Aug 29 20:27:46.074254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 45/114] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:45 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:46.163499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:46.164245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:46.170591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:46.171105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:46.171555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:46.175082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:46.175082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:46.175082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:46.353786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:46.363056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-aa563de3-55f6-4499-b92d-74ecd59705ce tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.203662 Aug 29 20:27:46.363637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 70/115] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:46 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:46.671605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:46.672247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:46.678852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:46.683826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:46.683826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:46.683826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:46.683826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:46.684125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:46.853273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:46.861594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5e1cf445-5dab-48c3-b76e-891eb9c5a756 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1314 microversion: 2.1 time: 0.194496 Aug 29 20:27:46.862155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 46/116] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:46 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:47.093403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:47.094014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:47.099890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.100403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.100840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.101583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.102036 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.102457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.235806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:47.244594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5be37d19-310d-453f-9811-b477e3654993 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.154597 Aug 29 20:27:47.246016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 71/117] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:47 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:47.386056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:47.387251 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:47.393598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.394071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.394521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.395277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.395693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.396346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.559960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:47.570804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-40857608-3c51-412e-8f04-9b56134dc976 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1322 microversion: 2.1 time: 0.190652 Aug 29 20:27:47.571387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 47/118] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:47 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:47.883063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:47.884317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:47.890001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.890945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.891897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.893187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.893956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.894675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.913355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cc3eff-660a-4cdb-93ec-9c5083607486", "name": "network-vif-plugged", "status": "completed", "tag": "f5ff56a2-aee4-446c-bcb9-f9ea4afb3168"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:47.931670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:47.935388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:47.935388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:47.955328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] Creating event network-vif-plugged:f5ff56a2-aee4-446c-bcb9-f9ea4afb3168 for instance 01cc3eff-660a-4cdb-93ec-9c5083607486 on hv-cinder-85200 Aug 29 20:27:47.970083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-15ce86c3-a659-42b2-a2f5-c08fa53f3c56 req-aae4726c-fc49-4a76-a43c-d3740efd5a6f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061712 Aug 29 20:27:47.974975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 48/119] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:48.049157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:48.057842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d9c3f881-402c-4313-a28e-09af8442fbf1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1499 microversion: 2.1 time: 0.179167 Aug 29 20:27:48.058879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 72/120] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:47 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1499 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:48.269855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:48.270628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:48.281947 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.284034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.284379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.285112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.285569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.285994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.328558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:48.486660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:48.496414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-97fca44e-a2fd-49ff-8e1a-bd527bea6d3d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.232761 Aug 29 20:27:48.496992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 49/121] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:48 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:48.592759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:48.593384 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:48.599267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.599743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.600235 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.600915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.601387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.601809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.771992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:48.781010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-564c19bd-f901-40f8-ab22-6bd7fc434926 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1515 microversion: 2.1 time: 0.192655 Aug 29 20:27:48.788583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 73/122] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:48 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:48.803993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:48.807497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:48.829194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.829981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.830659 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.831560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:48.832538 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:48.833122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:48.905539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'flavor' on Instance uuid ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:27:49.297218 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-59b8a300-c965-4842-b2d5-47e1a07c25d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6/action" status: 200 len: 32 microversion: 2.1 time: 0.499297 Aug 29 20:27:49.298154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 50/123] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:27:48 2022] POST /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6/action => generated 32 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:27:49.307663 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:49.308759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:49.314977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:49.315680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:49.316390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:49.317280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:49.317979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:49.319042 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:49.474822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:49.483880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ae301375-f9a0-4498-acbf-36e35f83619b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.180032 Aug 29 20:27:49.484491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 74/124] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:49 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:49.517196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:49.518213 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:49.524930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:49.525403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:49.526119 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:49.527532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:49.528160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:49.528811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:49.672626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:49.680253 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5f49348f-3b97-41ef-ab9b-21867f265750 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.167262 Aug 29 20:27:49.680825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 51/125] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:49 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:50.505052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:50.509284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:50.512952 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:50.513497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:50.514001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:50.514753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:50.515216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:50.515743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:50.700192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:50.702922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:50.705289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:50.708760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-13fe88b4-561f-4425-9184-56036bb16dc0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.207257 Aug 29 20:27:50.709544 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 75/126] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:50 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:50.718490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:50.719061 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:50.719559 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:50.720398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:50.720948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:50.721469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:50.852315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:50.863658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0bbefe8b-3227-480e-b5b7-f8d805ad0584 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.165958 Aug 29 20:27:50.864288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 52/127] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:50 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:51.733805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:51.735108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:51.742242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:51.743437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:51.744094 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:51.750130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:51.750130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:51.750130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:51.890503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:51.891737 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:51.907404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:51.907404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:51.907404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:51.907404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:51.907967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:51.907967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:51.962117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:51.980500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-72118baa-3905-48e2-ae59-a32a24ec5874 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.246758 Aug 29 20:27:51.980500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 76/128] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:51 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:52.051657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:52.063155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-73a04130-3f24-428d-b225-74f1d51a438e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.182325 Aug 29 20:27:52.064000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 53/129] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:51 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:52.997314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:52.997314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:53.006465 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.007568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.008554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.013312 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.013998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.014708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.085131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:53.086327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:53.100719 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.101608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.102521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.103532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.103995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.104448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.231453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:53.241368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ad8d365d-d04c-468c-a60b-4b5e37dbbc6b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.247197 Aug 29 20:27:53.259045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 77/130] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:52 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:53.309454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc58a7c-5989-4071-88c3-67ac07696069"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:53.312226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:53.318658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.319399 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.320022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.320910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:53.321514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:53.322077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:53.438836 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:53.447478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6eaa3e53-5355-455a-a375-0fa96262adbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.366949 Aug 29 20:27:53.448455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 54/131] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:53 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:54.265293 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:54.265924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:54.274405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:54.274882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:54.275318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:54.282138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:54.282632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:54.283066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:54.431719 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:54.442752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-18dbff4c-93ab-419c-8745-d2e46f7a3e2b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.181738 Aug 29 20:27:54.443514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 55/132] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:54 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:54.468705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:54.469319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:54.475379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:54.475904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:54.476460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:54.477174 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:54.477623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:54.478812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:54.700733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:54.709708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dfecc766-54ca-458b-a114-68791a90506a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.244813 Aug 29 20:27:54.710903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 56/133] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:54 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:55.132187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f6ac1d2-d07f-4478-9c22-c97f6e6ca611 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "POST /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.826965 Aug 29 20:27:55.133123 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 78/134] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:27:53 2022] POST /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106/os-volume_attachments => generated 194 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:55.465537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:55.466721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:55.472880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:55.473362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:55.473790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:55.474473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:55.474919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:55.475636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:55.634871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:55.646795 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e4667149-42bb-4cf7-81c8-45b24a2725de tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.186138 Aug 29 20:27:55.647379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 57/135] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:55 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:55.733472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:55.734202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:55.740971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:55.745276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:55.746119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:55.747009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:55.747618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:55.748367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:55.753066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:55.883009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:55.891149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7e57b721-398e-4ac7-bbaa-61c155197820 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1361 microversion: 2.1 time: 0.163778 Aug 29 20:27:55.891715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 79/136] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:55 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:56.669898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:56.670662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:56.676651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:56.677130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:56.677742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:56.678457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:56.679065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:56.679487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:56.823939 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:56.832020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5f65a4fa-d0dd-4846-ac79-b9292c5810fa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.167331 Aug 29 20:27:56.832988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 58/137] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:56 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:56.912494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:56.912494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:56.920243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:56.920243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:56.920512 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:56.921525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:56.922133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:56.922736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:57.057434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:57.065250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6800d0a6-a90a-4dad-8a57-7004a81795e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1547 microversion: 2.1 time: 0.158336 Aug 29 20:27:57.065817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 80/138] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:56 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:57.086536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:57.089561 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:57.093692 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:57.094176 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:57.094615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:57.095331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:57.095948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:57.096453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:57.173682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e084d17a-a5fd-4e10-8b33-2e193cdf435c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091056 Aug 29 20:27:57.174273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 59/139] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:27:57 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:27:57.854330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:57.854935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:57.861593 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:57.862085 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:57.862506 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:57.863197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:57.863647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:57.864096 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:58.037178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:58.046676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8631dc7c-272a-41a3-aad5-1665495030a8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.196525 Aug 29 20:27:58.060929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 81/140] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:57 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:58.765230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cc3eff-660a-4cdb-93ec-9c5083607486", "tag": "f5ff56a2-aee4-446c-bcb9-f9ea4afb3168"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:58.774712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:58.775375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:58.775812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:58.790871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] Creating event network-changed:f5ff56a2-aee4-446c-bcb9-f9ea4afb3168 for instance 01cc3eff-660a-4cdb-93ec-9c5083607486 on hv-cinder-85200 Aug 29 20:27:58.807002 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-9691e5c2-7cc5-4f21-9831-39cb00a7cd15 req-00e0f181-9f7a-4420-8d3d-2878b7cf80d3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045088 Aug 29 20:27:58.807777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 60/141] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:59.067490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:59.069432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:59.081737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:59.082642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:59.083580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:59.085878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:59.086804 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:59.087666 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:59.312854 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:59.321937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8be3cb39-623b-46ee-b8f0-59f627bac9eb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.258262 Aug 29 20:27:59.326278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 82/142] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:27:59 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:00.345602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:00.346296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:00.352393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:00.352878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:00.353315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:00.354003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:00.354457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:00.354889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:00.491887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:00.500556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-89c21309-6cbd-490b-943d-42c3b2514080 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.159185 Aug 29 20:28:00.501119 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 61/143] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:00 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:01.522339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:01.522937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:01.529670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:01.530142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:01.530567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:01.531234 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:01.531681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:01.532092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:01.682774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:01.692188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-65f9ba69-71ba-4376-9f61-242e23d8840b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.173727 Aug 29 20:28:01.692929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 83/144] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:01 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:02.714472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:02.715786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:02.721773 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:02.722255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:02.722710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:02.723379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:02.723833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:02.724285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:02.872855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:02.880652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-af1286ed-84ff-485a-8cc3-93ad3c9e070c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.170733 Aug 29 20:28:02.881329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 62/145] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:02 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:03.903723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:03.904792 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:03.911418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:03.911919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:03.912383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:03.913255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:03.913873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:03.914335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:04.081656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:04.090034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-42cb0bfb-25f5-4a2f-b391-8d96139d6f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.190769 Aug 29 20:28:04.090691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 84/146] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:03 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:05.111442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:05.112338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:05.114741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=69 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:05.119593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:05.120083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:05.120567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:05.121742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:05.122490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:05.122905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:05.273446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:05.282469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-65971583-e6fe-43b6-a423-df5cb9c35745 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.174939 Aug 29 20:28:05.296923 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 63/147] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:05 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:06.305156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:06.305761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:06.315108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:06.315108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:06.315532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:06.316305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:06.316749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:06.317330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:06.473967 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:06.482309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-52f4e1f1-1a9a-452e-8b32-4157eb73a327 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.180806 Aug 29 20:28:06.482821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 85/148] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:06 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:07.506108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:07.507784 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:07.515385 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:07.515876 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:07.516346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:07.517034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:07.517484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:07.518163 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:07.771242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:07.790590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9b774b3a-0825-41ff-aa0a-e6e5781e7e44 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.288995 Aug 29 20:28:07.804187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 64/149] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:07 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:08.321322 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:08.322146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:08.324420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=62 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:08.329366 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.329852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.330283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:08.331158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.331605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.332037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:08.375353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:28:08.812312 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:08.812935 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:08.818879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.819390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.820043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:08.820751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.821208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.821634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:08.826326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:08.836012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e7cccc03-a8e0-4fd9-b589-1b8c6804a1e0 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "DELETE /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 204 len: 0 microversion: 2.1 time: 0.518338 Aug 29 20:28:08.836651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 86/150] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:28:08 2022] DELETE /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:28:08.851722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:08.851722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:08.853757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.854431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.854886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:08.855578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:08.856052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:08.856498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:09.014818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:09.023737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7d07f7cf-6ffd-4826-9d24-d33dba2069a9 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1551 microversion: 2.1 time: 0.182408 Aug 29 20:28:09.024357 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 87/151] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:08 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1551 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:09.177036 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:09.185175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e9ced4e8-d86d-476b-8907-364980aa31da tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.377538 Aug 29 20:28:09.185741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 65/152] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:08 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:28:10.054594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:10.055209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:10.062712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:10.063195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:10.063631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:10.064344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:10.064798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:10.065271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:10.206964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:10.208571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:10.217307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:10.217800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:10.218236 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:10.218933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:10.219545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:10.219977 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:10.270259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:10.284049 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b8b2c911-0646-41f0-9c99-44e46922529c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1551 microversion: 2.1 time: 0.233722 Aug 29 20:28:10.289716 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 88/153] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:10 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1551 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:10.394361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:10.402542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7783a12c-9dae-4fb9-b759-2dba9afc5b4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.199719 Aug 29 20:28:10.406688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 66/154] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:10 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:11.310072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:11.310865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:11.318224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:11.318796 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:11.319338 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:11.320210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:11.320739 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:11.321220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:11.426410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:11.427192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:11.436338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:11.437053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:11.437860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:11.438780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:11.439703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:11.440463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:11.475100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:11.487640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2eda4c9e-0da3-4fbc-922a-ffe7f963fcad tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1551 microversion: 2.1 time: 0.177844 Aug 29 20:28:11.487640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 89/155] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:11 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:11.604017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:11.612299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d064bb25-7989-4790-be61-16c48323d4a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.190279 Aug 29 20:28:11.613323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 67/156] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:11 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:12.476631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87805c1d-b091-4831-92e8-6aea8583a106", "name": "network-vif-deleted", "tag": "1de6b5ac-8354-472a-992f-46151d073a06"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:12.488579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:12.489062 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:12.489487 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:12.504014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] Creating event network-vif-deleted:1de6b5ac-8354-472a-992f-46151d073a06 for instance 87805c1d-b091-4831-92e8-6aea8583a106 on hv-cinder-85200 Aug 29 20:28:12.505274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:12.507661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:12.509650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-044a5b29-6644-47e8-b1ed-98c1d5fc7f6a req-ee19ce8c-5e5d-47c4-9580-57129b3aae54 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036562 Aug 29 20:28:12.510406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 90/157] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:28:12.515985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:12.516498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:12.516929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:12.517623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:12.518361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:12.518977 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:12.612282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:12.629954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8b30a4f4-b4f8-41f0-8743-77ae999e734a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1509 microversion: 2.1 time: 0.128385 Aug 29 20:28:12.643150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:12.643815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 68/158] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:12 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:28:12.643924 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:12.657470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:12.657470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:12.657470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:12.657470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:12.658031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:12.658031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:12.800294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:12.809754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2526cc97-3af0-41ab-8c38-dc13585c8bde tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.170375 Aug 29 20:28:12.810330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 91/159] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:12 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:13.650690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:13.653288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:13.660781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:13.661272 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:13.661875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:13.662730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:13.663999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:13.664603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:13.739739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:13.748497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a29b86ba-981a-4a0c-a751-7563faa4bbfa tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1509 microversion: 2.1 time: 0.101669 Aug 29 20:28:13.749071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 69/160] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:13 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1509 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:13.834462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:13.835598 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:13.842884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:13.842884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:13.842884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:13.843356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:13.843812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:13.844252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:14.003532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:14.011631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-58939671-096e-4ed7-8e67-de3760e04992 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.181186 Aug 29 20:28:14.015202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 92/161] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:13 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:14.776066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:14.777331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:14.784576 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:14.785056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:14.785499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:14.786192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:14.786644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:14.787072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:14.866175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:14.875426 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-869075ff-94f5-49b1-bdaf-ffcf66e5c0b1 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1345 microversion: 2.1 time: 0.104397 Aug 29 20:28:14.875896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 70/162] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:14 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:15.038047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:15.038791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:15.046613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:15.047293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:15.047940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:15.049435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:15.050311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:15.051302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:15.226156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:15.234673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-85a0f78c-4ea4-45e9-bd22-bc37788af60d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.205178 Aug 29 20:28:15.235402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 93/163] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:15 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:15.897149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:15.897598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:15.917704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:15.921444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:15.921965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:15.922766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:15.923232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:15.923673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:16.013051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:16.022638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2b1e36da-5757-4675-bd2a-e98f26b3f92a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1345 microversion: 2.1 time: 0.130707 Aug 29 20:28:16.023248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 71/164] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:15 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:16.256688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:16.269437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:16.276791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:16.278762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:16.278762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:16.278762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:16.279479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:16.279665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:16.464416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:16.485789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:16.490932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-98c67389-899c-4bcd-b57f-3bdb619af017 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.239160 Aug 29 20:28:16.492377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 94/165] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:16 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:17.046772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:17.048101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:17.057068 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:17.058332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:17.059471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:17.060421 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:17.061787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:17.062976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:17.099627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:17.100114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:17.100578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:17.101023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lazy-loading 'fault' on Instance uuid 87805c1d-b091-4831-92e8-6aea8583a106 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:28:17.150341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c823ba2f1a1b441989d27846a43d60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaee9c0d7014c88b9b08f4f5e020a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:17.159512 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9a1f7c0f-821b-4ead-b14e-e6661f6aba7a tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 200 len: 1350 microversion: 2.1 time: 0.120470 Aug 29 20:28:17.168983 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 72/166] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:17 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 1350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:17.513300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:17.514110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:17.526153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:17.526660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:17.527176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:17.528158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:17.528849 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:17.529280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:17.740641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:17.752106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ea210b8e-8d6f-416c-b56e-ec436ec9d4c7 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.243211 Aug 29 20:28:17.753029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 95/167] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:17 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:18.181579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:18.182053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:18.194850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.195667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.196369 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.197276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.197929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.199083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.215141 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] HTTP exception thrown: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Request method failure captured: Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 HTTP/1.1 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEZZ2eJ4gAbnkD3wriqfKoMlSigQI8TAVf9UA6FpVl_BTTuJQwnFPUL3pyezb1u7bWfj1VpJ5RIi0Bmk9kCqMH7hEtsU3WPcbezwZi2WQB8f96wPyyfnoVyUs4OPLdP6yJUotmMK746tFmU6argDED_f0NArnS99dhYoj6mjnEzrNU Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:28:18.219751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0eaee9c0d7014c88b9b08f4f5e020a66", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: c823ba2f1a1b441989d27846a43d60ad Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.221030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '87805c1d-b091-4831-92e8-6aea8583a106'} Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:28:18.221865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.222972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.224042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Returning 404 to user: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:28:18.224042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-954f2745-e80a-42a3-94e8-5538a1724753 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 404 len: 111 microversion: 2.1 time: 0.043720 Aug 29 20:28:18.225419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 73/168] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:18 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:28:18.699599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:18.702890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:18.710369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.711030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.711604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.713272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.713876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.714297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.728270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] HTTP exception thrown: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Request method failure captured: Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106/os-volume_attachments HTTP/1.1 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEZZ2eJ4gAbnkD3wriqfKoMlSigQI8TAVf9UA6FpVl_BTTuJQwnFPUL3pyezb1u7bWfj1VpJ5RIi0Bmk9kCqMH7hEtsU3WPcbezwZi2WQB8f96wPyyfnoVyUs4OPLdP6yJUotmMK746tFmU6argDED_f0NArnS99dhYoj6mjnEzrNU Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:28:18.733703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0eaee9c0d7014c88b9b08f4f5e020a66", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: c823ba2f1a1b441989d27846a43d60ad Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.735168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'server_id': '87805c1d-b091-4831-92e8-6aea8583a106'} Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:28:18.736180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:18.737868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:18.739557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Returning 404 to user: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:28:18.739557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e8857aaf-7b35-4ea6-8b85-da69c9d7e62c tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039680 Aug 29 20:28:18.741781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 96/169] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:28:18 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:28:18.775342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:18.776103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:18.782653 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.783255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.783894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.784680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:18.785234 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:18.785758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:18.933148 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:18.943808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-84c38ba3-cbac-4753-b247-1f16a9de2b83 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.173151 Aug 29 20:28:18.944480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 74/170] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:18 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:19.965884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:19.966490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:19.983108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:19.983108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:19.983108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:19.983108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:19.983462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:19.983462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:20.104379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:20.112880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-81660565-d4fe-42c2-856c-9335a167fb28 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.151053 Aug 29 20:28:20.122932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 97/171] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:19 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:21.133642 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:21.134239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:21.140749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:21.141219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:21.141710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:21.142372 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:21.142813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:21.143496 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:21.272352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:21.280265 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6cf7fdf0-5ade-4de7-9c36-19ee6b7472b3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.150430 Aug 29 20:28:21.280838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 75/172] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:21 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:22.300870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:22.301623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:22.307841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.308365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.309370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.310073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.310954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.310954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.447106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:22.454873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8b1a062b-cffe-4de7-88fe-599d9109e49e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.157928 Aug 29 20:28:22.455520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 98/173] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:22 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:22.583732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:22.584408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:22.591632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.592196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.592620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.594640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.594640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.594640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.611504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] HTTP exception thrown: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Request method failure captured: Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 HTTP/1.1 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEZZ2eJ4gAbnkD3wriqfKoMlSigQI8TAVf9UA6FpVl_BTTuJQwnFPUL3pyezb1u7bWfj1VpJ5RIi0Bmk9kCqMH7hEtsU3WPcbezwZi2WQB8f96wPyyfnoVyUs4OPLdP6yJUotmMK746tFmU6argDED_f0NArnS99dhYoj6mjnEzrNU Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:28:22.613743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0eaee9c0d7014c88b9b08f4f5e020a66", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: c823ba2f1a1b441989d27846a43d60ad Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.615133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '87805c1d-b091-4831-92e8-6aea8583a106'} Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:28:22.615891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.617946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.620248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Returning 404 to user: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:28:22.620248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dac37cb0-fcab-41e1-9d6a-25659b193154 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "DELETE /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 404 len: 111 microversion: 2.1 time: 0.036326 Aug 29 20:28:22.620248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 76/174] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:28:22 2022] DELETE /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:28:22.624548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:22.625144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] [instance: 87805c1d-b091-4831-92e8-6aea8583a106] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:22.631078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.631554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.631980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.632684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:22.633123 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:22.633538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:22.647033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] HTTP exception thrown: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Request method failure captured: Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 HTTP/1.1 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEZZ2eJ4gAbnkD3wriqfKoMlSigQI8TAVf9UA6FpVl_BTTuJQwnFPUL3pyezb1u7bWfj1VpJ5RIi0Bmk9kCqMH7hEtsU3WPcbezwZi2WQB8f96wPyyfnoVyUs4OPLdP6yJUotmMK746tFmU6argDED_f0NArnS99dhYoj6mjnEzrNU Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:28:22.649217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0eaee9c0d7014c88b9b08f4f5e020a66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0eaee9c0d7014c88b9b08f4f5e020a66", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 0eaee9c0d7014c88b9b08f4f5e020a66 Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-DeleteServersTestJSON-826290543 Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: c823ba2f1a1b441989d27846a43d60ad Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-DeleteServersTestJSON-826290543-project Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.650937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '87805c1d-b091-4831-92e8-6aea8583a106'} Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:28:22.651665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. Aug 29 20:28:22.653340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:28:22.654523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] Returning 404 to user: Instance 87805c1d-b091-4831-92e8-6aea8583a106 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:28:22.654523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e896fddf-e437-4846-a04b-6abbb16214d2 tempest-DeleteServersTestJSON-826290543 tempest-DeleteServersTestJSON-826290543-project] 10.222.0.85 "GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106" status: 404 len: 111 microversion: 2.1 time: 0.029989 Aug 29 20:28:22.654523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 99/175] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:22 2022] GET /compute/v2.1/servers/87805c1d-b091-4831-92e8-6aea8583a106 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:28:23.476940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:23.477605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:23.484187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:23.484676 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:23.485102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:23.485784 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:23.486224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:23.486639 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:23.641554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:23.649595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c3117fb3-dc97-4136-9093-2e8b020db086 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.176704 Aug 29 20:28:23.655019 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 77/176] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:23 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:24.671629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:24.672410 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:24.680651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:24.681715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:24.682359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:24.683300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:24.684950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:24.685632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:24.990467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:25.002522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d71e21a3-5e32-44d0-9d68-57c1c4d67c1d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.335436 Aug 29 20:28:25.003527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 100/177] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:24 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:26.024832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:26.025441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:26.032562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:26.032562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:26.032902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:26.033682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:26.034135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:26.034563 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:26.176567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:26.184963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5d18d074-3f5f-4b0d-86ae-7f4b67f2ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.164001 Aug 29 20:28:26.185526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 78/178] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:26 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:27.212425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:27.213920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:27.222054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:27.222781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:27.223452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:27.224425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:27.225077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:27.225700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:27.361998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:27.370095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a0e1e1af-bcd2-4ea8-ba01-bba38ab4668c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.168104 Aug 29 20:28:27.371301 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 101/179] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:27 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:28.394013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:28.394654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:28.400767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:28.401249 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:28.401707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:28.402391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:28.402848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:28.403268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:28.543620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:28.551239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4103da9e-dede-4a53-ac3f-f222f706c2f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.161375 Aug 29 20:28:28.564198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 79/180] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:28 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:29.573503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:29.575324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:29.583344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:29.584233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:29.584827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:29.586203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:29.586837 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:29.587427 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:29.734105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:29.742683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6fdd08bf-4920-44b8-96a7-03ecd21ba173 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.173632 Aug 29 20:28:29.755982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 102/181] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:29 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:30.763195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:30.763898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:30.790006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:30.790534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:30.791000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:30.791701 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:30.792148 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:30.792648 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:30.981157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:30.996352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d8504e92-e39c-4450-a8ed-0f8516f4fe4e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.235909 Aug 29 20:28:30.997549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 80/182] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:30 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:32.018113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:32.018981 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:32.035729 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:32.036230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:32.036873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:32.037721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:32.038316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:32.038887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:32.228827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:32.237595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6230b8fa-862b-4d3e-b24a-50aa303a7ec3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.223270 Aug 29 20:28:32.238370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 103/183] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:32 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:33.260040 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:33.260704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:33.270201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:33.270705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:33.271316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:33.272272 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:33.276408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:33.277120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:33.511356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:33.519371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0de1bd89-ce15-4314-9816-7aec5f8cb5ae tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.263020 Aug 29 20:28:33.520216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 81/184] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:33 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:34.544546 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:34.546465 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:34.555295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:34.556327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:34.556979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:34.559056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:34.559710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:34.560419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:34.818556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:34.842881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e5fc779a-2525-4abc-a4f4-a0d7d1e9fbc8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.292696 Aug 29 20:28:34.842881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 104/185] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:34 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:35.878374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:35.879625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:35.886700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:35.887492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:35.888290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:35.895328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:35.895328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:35.895328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:36.093205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:36.097082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:36.103492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cc2947da-4235-458b-b0c8-5da5b98eb7a9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.229935 Aug 29 20:28:36.106068 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 82/186] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:35 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:36.538350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6407e55b-87d5-4473-aa43-1a9bb932e3e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: .version_select at 0x7f89883f5160>, body: {"keypair": {"name": "tempest-keypair-1332194894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaWml2qH2oQO+E4CCqSpHj70PY2JLC311cjK+eGKHZeX2/NszdU+Up2blMN/iR9W1lf3nBKTaLO9fHdIxpEhHY+7XIw6iwdSJpIwSkDDH8EpNA1REQVns87YcEMAy2DQg=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:36.558337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-6407e55b-87d5-4473-aa43-1a9bb932e3e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for project e6f51ffa08494524b47ac220f1bd74de. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:28:36.563008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-6407e55b-87d5-4473-aa43-1a9bb932e3e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for user 859d36aa86bd403ca1d46b245efaef61 and project e6f51ffa08494524b47ac220f1bd74de. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:28:36.665858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6407e55b-87d5-4473-aa43-1a9bb932e3e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.244030 Aug 29 20:28:36.666463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 105/187] 10.222.0.85 () {62 vars in 1200 bytes} [Mon Aug 29 20:28:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:28:37.130115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:37.131099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:37.138463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:37.138956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:37.139387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:37.140271 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:37.140874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:37.141449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:37.340277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:37.349780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d7ff872a-ef26-49fc-981f-e991f2fb61cd tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.224408 Aug 29 20:28:37.350360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 83/188] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:37 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:38.379258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:38.380766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:38.397426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:38.400160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:38.400653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:38.402787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:38.403264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:38.403697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:38.685662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:38.702754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fe2f4ffd-898c-4adc-bc83-61650b3c9cab tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1521 microversion: 2.1 time: 0.327291 Aug 29 20:28:38.702754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 106/189] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:38 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:39.723301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:39.723917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:39.734322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=44 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:39.735910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:39.737468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:39.741619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:39.742606 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:39.744911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:39.745362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:39.866631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1137885276", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "437ad417-2104-45df-a56d-2f84426e2ca3"}], "security_groups": [{"name": "tempest-securitygroup--1518498205"}], "key_name": "tempest-keypair-1332194894", "user_data": "}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:39.968124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:39.977316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-662d0ad0-ab2f-499f-a11a-dea8330c9d6c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1501 microversion: 2.1 time: 0.257996 Aug 29 20:28:39.977897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 84/190] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:39 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:39.999427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:40.000121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:40.006173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:40.006649 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:40.007073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:40.007747 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:40.008242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:40.008661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:40.029698 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] validate_networks() for [('437ad417-2104-45df-a56d-2f84426e2ca3', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:28:40.166669 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:40.177769 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-abd8a764-e27d-445c-a60d-1392b96f1ed6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1514 microversion: 2.1 time: 0.181653 Aug 29 20:28:40.185190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 85/191] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:39 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:28:40.521998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:40.853536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:28:40.854051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:28:40.854524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:28:40.855038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:28:40.855447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:28:40.866067 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:40.866681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:40.867645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:40.868614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:40.869245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:40.869863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:40.893325 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for project e6f51ffa08494524b47ac220f1bd74de. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:28:40.897651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for user 859d36aa86bd403ca1d46b245efaef61 and project e6f51ffa08494524b47ac220f1bd74de. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:28:40.910512 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:28:40.912897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:28:41.149655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d89bf04b-52b1-4066-bc1d-efb71863964d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.287757 Aug 29 20:28:41.162734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:41.163398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:41.169710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 107/192] 10.222.0.85 () {62 vars in 1188 bytes} [Mon Aug 29 20:28:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 20:28:41.232540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:41.240199 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:41.241618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:41.242730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-232779ae-03a4-4b67-81fe-771f50dacbb9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1282 microversion: 2.20 time: 0.084271 Aug 29 20:28:41.243292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 86/193] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:41 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:42.266806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:42.267415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:42.321991 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:42.330733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:42.332304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:42.333665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-672fc804-ca7e-4a92-beff-00cd9bce9172 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1282 microversion: 2.20 time: 0.071818 Aug 29 20:28:42.334256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 108/194] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:42 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:43.356043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:43.356682 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:43.362868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:43.363340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:43.363769 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:43.364720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:43.365173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:43.365593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:43.428217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:43.436845 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:43.438286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:43.439376 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-735da2fe-4296-4cbc-8ce9-fbd81d2bcdb2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1334 microversion: 2.20 time: 0.087373 Aug 29 20:28:43.439925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 87/195] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:43 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:44.461904 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:44.462514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:44.470208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:44.470694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:44.471190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:44.471879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:44.472368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:44.472802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:44.534627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:44.543328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:44.544977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:44.545899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c68545b3-23c7-460f-a818-a44c3c26f5cd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1334 microversion: 2.20 time: 0.088065 Aug 29 20:28:44.546708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 109/196] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:44 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:28:45.567737 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:45.568405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:45.576810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:45.577395 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:45.577833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:45.578513 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:45.578963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:45.579384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:45.639138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:45.647420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:45.648909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:45.649992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9a17356b-b419-4e18-bd93-afc2826d5e57 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1334 microversion: 2.20 time: 0.086179 Aug 29 20:28:45.650577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 88/197] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:45 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:46.672866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:46.673487 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:46.680016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:46.680535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:46.680964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:46.681634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:46.682078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:46.682546 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:46.750717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:46.759450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:46.761199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:46.762826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-82b6eedc-220f-44f2-88c9-b1e7f0c18dcb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1342 microversion: 2.20 time: 0.094574 Aug 29 20:28:46.763395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 110/198] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:46 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:47.619536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:47.621947 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:47.628887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:47.629928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:47.630609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:47.632231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:47.633044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:47.633275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:47.663500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'flavor' on Instance uuid 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:28:47.787029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:47.787934 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:47.800999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:47.802597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:47.803101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:47.803851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:47.804454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:47.805090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:47.957460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:47.965547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:47.966991 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:47.968082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9bee09e2-e414-439d-bb84-e1f2cad39797 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.185123 Aug 29 20:28:47.969484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 111/199] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:47 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:28:48.058423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-36bdd993-4a64-4120-9ef7-37349d81913e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/action" status: 200 len: 32 microversion: 2.1 time: 0.442488 Aug 29 20:28:48.063181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 89/200] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:28:47 2022] POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:28:48.069695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:48.070717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:48.079063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:48.079681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:48.080126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:48.080883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:48.088654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:48.088654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:48.238832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:48.247827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1ef39826-a2fa-4708-9c65-d4331560f4c1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.183149 Aug 29 20:28:48.248442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 112/201] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:48 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:48.679304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:48.693837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:48.694383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:48.695157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:48.706596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] Creating event network-changed:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:28:48.711327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-077b00c9-a790-4899-bf67-71f1505e3177 req-70c1cd98-c28e-471a-a929-db2888fee2d3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037692 Aug 29 20:28:48.711919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 90/202] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:28:48.995301 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:48.996510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:49.003210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:49.003807 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:49.004239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:49.007812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:49.007812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:49.007812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:49.185350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:49.204664 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:49.211294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:49.220323 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3462ebc5-d3a5-48bb-9d43-5b42439c8b85 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.222840 Aug 29 20:28:49.231093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 113/203] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:48 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:49.272669 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:49.273835 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:49.280684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:49.281405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:49.282067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:49.283023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:49.283640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:49.284245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:49.582900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:49.591137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-271eba8d-e1f0-47e4-a086-4efbca525b14 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.325891 Aug 29 20:28:49.591710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 91/204] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:49 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:50.252154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:50.253014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:50.267091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:50.270695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:50.273981 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:50.279842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:50.280497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:50.283017 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:50.291862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=91 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:50.494111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:50.502237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:50.503919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:50.505430 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7ce8b17d-a200-4361-9126-e4a2c0e67b07 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.256775 Aug 29 20:28:50.505928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 114/205] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:50 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:50.613631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:50.614245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:50.620486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:50.620970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:50.621480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:50.622094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:50.622549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:50.622978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:50.851139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:50.873286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3a8218b7-08f2-4e63-87c2-843609a6f26c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.257445 Aug 29 20:28:50.874818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 92/206] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:50 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:51.528757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:51.529445 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:51.535823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:51.543570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:51.544794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:51.545244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:51.546294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:51.549339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:51.549787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:51.814567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:51.824829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:51.826802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:51.827969 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-373d5616-9988-4f71-8f5b-d14bbc4f5017 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.303814 Aug 29 20:28:51.828568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 115/207] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:51 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:51.898557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:51.899919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:51.906579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:51.908334 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:51.908994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:51.909590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:51.910630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:51.911234 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:51.911826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:52.126042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:52.139650 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a4350581-b498-4dea-ac22-8233f8766323 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.247040 Aug 29 20:28:52.153507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 93/208] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:51 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:52.851498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:52.852728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:52.855873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=12 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:52.861538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:52.862252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:52.862679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:52.863367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:52.863812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:52.864259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:53.014010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:53.036883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:53.036883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:53.038003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-533f0d31-5e50-458d-9969-841732900949 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.190439 Aug 29 20:28:53.039005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 116/209] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:52 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:28:53.165969 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:53.166578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:53.177978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:53.178753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:53.179425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:53.180343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:53.180967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:53.181671 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:53.328589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:53.337450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fb81954e-1650-4cc2-96ce-e705622bc43d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.175565 Aug 29 20:28:53.338246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 94/210] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:53 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:54.061154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:54.062388 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:54.070248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:54.070889 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:54.071489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:54.072368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:54.073011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:54.074035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:54.279775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:54.289856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:54.291855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:54.293255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0ecbae9d-5646-4ed8-a804-84113232c23f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.236600 Aug 29 20:28:54.294391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 117/211] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:54 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:54.360379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:54.360996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:54.366966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:54.367455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:54.368067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:54.368945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:54.369556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:54.370141 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:54.534910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:54.543707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-67352f38-b4e4-4057-9c6e-16ceee46a5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.187566 Aug 29 20:28:54.544405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 95/212] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:54 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:28:55.323802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:55.325570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:55.335700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:55.336636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:55.337146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:55.337911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:55.338552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:55.339064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:55.505759 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "name": "network-vif-plugged", "status": "completed", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:28:55.516724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:55.518952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:55.519446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:55.535432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:55.546102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] Creating event network-vif-plugged:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:28:55.561612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-94032586-f91f-464a-9744-8f1c7f87036b req-e92ecb8a-5999-4874-b427-cc8fc904e527 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058986 Aug 29 20:28:55.562414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 96/213] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:28:55.563724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:55.566913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:55.568070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2260ddf1-9dba-43ce-a89e-9b5b3b2d3f28 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.250815 Aug 29 20:28:55.580657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:55.583660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:55.588351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 118/214] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:55 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:55.594142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:55.594741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:55.595320 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:55.596425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:55.597257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:55.597996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:55.778938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:55.792867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-15f7647a-b917-46b1-b702-591d175a3bea tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.222739 Aug 29 20:28:55.793734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 97/215] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:55 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:56.600302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:56.600974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:56.615516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:56.616026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:56.616513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:56.617987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:56.618120 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:56.618548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:56.800379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:56.814007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:56.815203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:56.822032 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:56.823868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:56.824635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:56.825237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:56.825668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fd55b52a-67a2-4092-8dca-9641ce041776 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.229414 Aug 29 20:28:56.825797 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:56.826571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:56.827257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 119/216] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:56 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:56.838192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:56.838814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:57.011734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:57.020415 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ab5c7f12-cab2-4862-8161-f9639c3f3964 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.210026 Aug 29 20:28:57.035965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 98/217] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:56 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:57.848078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:57.848721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:57.855677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:57.856675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:57.857153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:57.858228 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:57.858867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:57.859270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:58.042916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:58.045282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:58.050057 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:58.051123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:58.051123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:58.051746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:58.052219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:58.052645 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:58.163036 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:58.185205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:58.186776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:58.187915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3b5ae6d5-d028-4abc-b09e-1b39bc8594be tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1408 microversion: 2.20 time: 0.343847 Aug 29 20:28:58.188510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 120/218] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:57 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:58.280796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:58.284777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:58.292917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-977a5dce-7434-4515-bdae-045c04f9587e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.253870 Aug 29 20:28:58.295957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 99/219] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:58 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:28:59.213440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:59.215247 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:59.222120 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.222872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.240065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.240065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.240065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.240065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.337843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:59.338467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:59.359875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.360415 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.360903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.361807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.363328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.364720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.450438 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:59.460400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:59.462420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:59.465020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8573b3c8-017c-4cdc-80b8-31996b416a2a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1601 microversion: 2.20 time: 0.254555 Aug 29 20:28:59.483654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 121/220] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:28:59 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1601 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:28:59.489252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:28:59.489941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:28:59.496538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.497286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.497870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.498718 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:28:59.499167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:28:59.499756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:28:59.582590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:28:59.599875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cf1f5451-b9e5-481b-9b37-584882d68315 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.274381 Aug 29 20:28:59.602016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 100/221] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:28:59 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:28:59.689591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6d7abd6e-4d28-4357-abde-11ce70191bbb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.204345 Aug 29 20:28:59.690997 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 122/222] 10.222.0.85 () {60 vars in 1316 bytes} [Mon Aug 29 20:28:59 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:29:00.631057 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:00.631668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:00.638035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:00.638562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:00.638997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:00.639678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:00.640147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:00.640578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:00.999475 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:01.008143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e8d3db92-fb2f-49ae-b242-a440c1c46eff tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.381096 Aug 29 20:29:01.012227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 101/223] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:00 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:01.370935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:01.396343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:01.396343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:01.396343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:01.426167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] Creating event network-changed:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:29:01.436829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-bb44be5c-42c4-44fb-9ba0-1fcfe9bbb329 req-3004ac7e-2d74-42f7-a15f-9319536501fa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Aug 29 20:29:01.436829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 123/224] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:02.032437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:02.033841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:02.041749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:02.042979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:02.043816 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:02.044792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:02.045440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:02.046072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:02.194424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:02.207373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ad78445e-1d69-4f46-9ddf-939cf2371cd0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.179693 Aug 29 20:29:02.207971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 102/225] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:02 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:03.230467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:03.233375 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:03.241272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:03.242113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:03.242415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:03.243116 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:03.243567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:03.243993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:03.417692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:03.426660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-00c21e5a-8303-409d-a77a-e3551f407b63 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.200534 Aug 29 20:29:03.427212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 124/226] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:03 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:04.452773 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:04.466117 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:04.487879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:04.491815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:04.491815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:04.491815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:04.491815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:04.492356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:04.545931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:04.547027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:04.553783 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:04.554746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:04.555336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:04.556403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:04.557005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:04.557633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:04.584195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b738c314-1fc2-4bea-9bae-5d67416f5197 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/ips" status: 200 len: 146 microversion: 2.1 time: 0.042665 Aug 29 20:29:04.585347 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 125/227] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:29:04 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:29:04.914165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:04.924126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-613b8a10-6c82-4bee-bd19-2cc4eba688d3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.477318 Aug 29 20:29:04.931813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 103/228] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:04 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:05.949133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:05.950332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:05.958787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:05.959500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:05.960157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:05.961145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:05.961788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:05.962536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:06.185216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:06.192948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fbc102c4-4c94-4b8d-b259-3961343a1225 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.250873 Aug 29 20:29:06.193514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 126/229] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:05 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:07.213982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:07.214581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:07.221284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:07.221757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:07.222192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:07.222907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:07.223351 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:07.223942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:07.398254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:07.411998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fe299fd5-7d73-415e-9063-ff5d24eedd97 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.201823 Aug 29 20:29:07.413767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 104/230] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:07 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:07.918251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccb7e0c7-1ba6-4fdd-91d5-a3dae0bf4ee4"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:07.920812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:07.927750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:07.928507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:07.928942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:07.929644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:07.930132 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:07.930900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:08.441231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:08.444922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:08.466516 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:08.468637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:08.470014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:08.473836 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:08.476797 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:08.480278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:08.718975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:08.739391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2c9137a0-b5fb-48c9-af98-62d70ad2d925 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.307756 Aug 29 20:29:08.739967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 105/231] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:08 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:09.257287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0c0ff406-1f55-4e16-a0a8-b8712c4000e6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.343833 Aug 29 20:29:09.258887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 127/232] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:29:07 2022] POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments => generated 194 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:09.761815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:09.762427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:09.768649 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:09.770116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:09.770554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:09.771258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:09.771735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:09.772146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:09.973779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:09.982391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-13a50aa9-1ecd-4696-b218-7d8e7d24249e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.225183 Aug 29 20:29:09.982972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 106/233] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:09 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:10.023878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b00743bb-7fa3-4ff1-b04a-7e3814aa9ac2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Action: 'create', calling method: .version_select at 0x7f8987983700>, body: {"keypair": {"name": "tempest-TestShelveInstance-105915495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO24GZi0l3m2RWSFN306sJZCgX0qiKuNAhR4Fu2tGLHi6SlrBT9gYDbD3WwSphHIXuyLIucx+V+mFhwP9kqzhq3YlSOdshv54G6X/wH28TaDihqve51lReehfC4XO5gIdA=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:10.043045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-b00743bb-7fa3-4ff1-b04a-7e3814aa9ac2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Getting quotas for project 8c28205e89c1441bbb3f1d68ac8893e4. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:10.048110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-b00743bb-7fa3-4ff1-b04a-7e3814aa9ac2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Getting quotas for user 95d668bfaf71417baac3c4336c33ed9f and project 8c28205e89c1441bbb3f1d68ac8893e4. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:10.134425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b00743bb-7fa3-4ff1-b04a-7e3814aa9ac2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.356751 Aug 29 20:29:10.135127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 128/234] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:29:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:29:11.005037 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:11.005630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:11.011514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:11.011988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:11.012456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:11.013135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:11.013578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:11.013992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:11.262774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:11.273289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8ca94bab-f1c2-4d94-88f2-b5e2d1e2d3c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.270229 Aug 29 20:29:11.284611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 107/235] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:10 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:12.295530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:12.303168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:12.304653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:12.305144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:12.305583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:12.306278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:12.306728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:12.307236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:12.492517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:12.506806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-73f825c1-b083-4cf2-a28d-3254e999321a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.215344 Aug 29 20:29:12.511895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 129/236] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:12 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:13.530444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:13.531065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:13.533084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=50 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:13.538930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.539839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.540461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:13.541406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.542423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.543039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:13.727675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:13.738573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6853ad5b-144a-4672-ac65-485581a22730 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1500 microversion: 2.1 time: 0.211844 Aug 29 20:29:13.744217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 108/237] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:13 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1500 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:13.763423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc73a155-5a55-4860-98e7-12c7769531e5"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:13.767645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:13.776585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.777329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.778470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:13.779943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.780596 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.781687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:13.812277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] HTTP exception thrown: Cannot 'attach_volume' instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 while it is in vm_state rescued Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Request method failure captured: Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/os-volume_attachments HTTP/1.1 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 74 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEdbr0UBGbc1Dkaicuy7soLHnPMv1dFKhKkjv81PWp3YW63sX1CUZXNW9OLOr9Eyg9B9cw0aWHIPuvvwgwdcnR9ZuLbR3nPeFnw_xLx5hYb8NDNwdcbazd1ADSsE11RR6IaYtXMWJ8eX4_p2qgfPRSHVug8lNZHOXLJTqaFF-H52ig Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:29:13.814232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_66be3e70cbf742269fe9306a7b7e8fe0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 336345e5437341ba9859d776c44ea4be Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {"volumeAttachment": {"volumeId": "cc73a155-5a55-4860-98e7-12c7769531e5"}} Aug 29 20:29:13.815758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Cannot 'attach_volume' instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 while it is in vm_state rescued Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'server_id': '61abe1ad-59b4-43ae-9922-b7ec7820a7b6', 'body': {'volumeAttachment': {'volumeId': 'cc73a155-5a55-4860-98e7-12c7769531e5'}}} Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:29:13.817294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 while it is in vm_state rescued Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:29:13.818635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:29:13.819831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:29:13.819831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:29:13.819831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 while it is in vm_state rescued Aug 29 20:29:13.819831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:29:13.820885 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Returning 409 to user: Cannot 'attach_volume' instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 while it is in vm_state rescued {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:29:13.821923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7befc8ea-3515-45fb-a7da-4add1cf88398 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063941 Aug 29 20:29:13.828060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 130/238] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:29:13 2022] POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:29:13.832821 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:13.833721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:13.842557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.843481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.845967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:13.847649 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:13.852860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:13.853494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:14.301783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d1084a3b-9e03-4a54-b7e2-ef9ef68139c9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.472502 Aug 29 20:29:14.303925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 109/239] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:29:13 2022] POST /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:29:14.316676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:14.318480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:14.328345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:14.328845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:14.329292 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:14.330142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:14.330597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:14.331105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:14.483033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:14.492561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e02692a6-a38c-4285-b219-0f87e6ed0804 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1508 microversion: 2.1 time: 0.185788 Aug 29 20:29:14.494928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 131/240] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:14 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:15.514830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:15.516235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:15.523360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:15.523857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:15.524332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:15.525032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:15.525484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:15.525907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:15.709647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:15.719978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bb9845b2-70a4-47a2-ae34-31b4a4c75cb8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1508 microversion: 2.1 time: 0.210428 Aug 29 20:29:15.720833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 110/241] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:15 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:16.753912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:16.754494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:16.757944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:16.763900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:16.764772 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:16.766024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:16.767024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:16.767655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:16.768077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:16.771520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:16.942590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:16.951612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-de75b4da-9000-43d8-8a14-196c9bc34950 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1508 microversion: 2.1 time: 0.201837 Aug 29 20:29:16.953858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 132/242] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:16 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:17.974932 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:17.975557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:17.982535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:17.983010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:17.983435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:17.984217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:17.984681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:17.985098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:18.120263 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:18.127765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4ad59817-e284-4a57-a070-63d7987a90e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1508 microversion: 2.1 time: 0.156950 Aug 29 20:29:18.128366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 111/243] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:17 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:19.149361 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:19.149941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:19.158102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:19.158667 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:19.159095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:19.159775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:19.160257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:19.160676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:19.328293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:19.338343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-23952094-291a-43c1-8cb7-a2ef386ddeac tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1514 microversion: 2.1 time: 0.193422 Aug 29 20:29:19.339470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 133/244] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:19 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:19.398483 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:19.405444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:19.405927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:19.406352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:19.468403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Going to try to stop instance {{(pid=121468) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:29:19.767139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c87641e2-24cd-4a4c-85ff-99b626413e40 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action" status: 202 len: 0 microversion: 2.1 time: 0.372579 Aug 29 20:29:19.767926 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 112/245] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:29:19 2022] POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:29:19.776545 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:19.777193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:19.783600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:19.784112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:19.784573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:19.785269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:19.785723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:19.786147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:19.940239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:19.948631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1e6c6df0-c6e8-42ed-8ec1-f1c2fb0b3985 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.175796 Aug 29 20:29:19.949193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 134/246] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:19 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:20.970414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:20.971147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:20.977179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:20.977673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:20.978117 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:20.978795 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:20.979242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:20.979661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:21.127855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9b9205e6-9c12-48bd-af99-2ad9ed66d055 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: .version_select at 0x7f89878ef8b0>, body: {"keypair": {"name": "tempest-keypair-792825005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw5la2t566WqJDHEDJAKSsD2jukacQmENFgdW6RvfGW1OL5JIS9snaJjMsXjoqgmVVpWqugKVmf/0qUHO0giJzwLxOpIEgf3QogrUdruMhUqQRrSpUrNq5InDm69MmUSg=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:21.128394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:21.128501 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:21.128608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bee1cf9d-b24f-4a48-9a5e-25cb6ad2a2be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.161649 Aug 29 20:29:21.128608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 113/247] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:20 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:21.139434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-9b9205e6-9c12-48bd-af99-2ad9ed66d055 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:21.143215 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-9b9205e6-9c12-48bd-af99-2ad9ed66d055 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for user 336345e5437341ba9859d776c44ea4be and project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:21.208194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9b9205e6-9c12-48bd-af99-2ad9ed66d055 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093513 Aug 29 20:29:21.208831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 135/248] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:29:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:29:22.149624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:22.150224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:22.156841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:22.157317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:22.157743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:22.158409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:22.158904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:22.159317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:22.180387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:22.294877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:22.303388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-35a899b3-b616-42a9-9551-19dd71e51a47 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.157594 Aug 29 20:29:22.303950 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 114/249] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:22 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:23.325774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:23.326387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:23.332509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:23.332997 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:23.333434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:23.334124 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:23.334582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:23.335009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:23.560768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:23.575714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9837d434-3fb0-489f-816e-df455f417935 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.255181 Aug 29 20:29:23.576398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 136/250] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:23 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:23.747553 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-454003314", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b32b458-e224-4b4c-8df7-a9ce6fdf0867"}], "security_groups": [{"name": "tempest-securitygroup--779208476"}], "key_name": "tempest-keypair-792825005", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:24.597411 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:24.598008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:24.604640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:24.605126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:24.605559 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:24.606298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:24.606922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:24.607345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:24.747363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:24.753546 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-946e3def-f703-4d31-9a64-96c70c41facd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.159955 Aug 29 20:29:24.754115 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 137/251] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:24 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:25.775179 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:25.775858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:25.782235 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:25.782718 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:25.783155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:25.783831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:25.784315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:25.784741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:26.082208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:26.090560 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9f769fe5-8c0e-4ae1-9d02-0550aa925ecf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.319304 Aug 29 20:29:26.091685 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 138/252] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:25 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:27.111736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:27.112831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:27.118780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:27.119248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:27.120195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:27.120883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:27.121330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:27.121750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:27.286848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:27.295903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-361d888e-ceec-451f-9bc7-5c0d129f20f2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.187980 Aug 29 20:29:27.298180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 139/253] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:27 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:28.317099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:28.317779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:28.327906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:28.327906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:28.327906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:28.327906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:28.328428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:28.328428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:28.468990 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:28.480381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6fe80515-8632-44eb-83e1-f92b716b77f1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.166819 Aug 29 20:29:28.481433 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 140/254] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:28 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:29.502979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:29.503637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:29.510052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:29.510528 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:29.510988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:29.511680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:29.512219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:29.512703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:29.689305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:29.701359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bd875b43-1f6f-43dd-b1fe-1b03c993baed tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.202203 Aug 29 20:29:29.702743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 141/255] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:29 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:30.723957 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:30.725365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:30.734633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:30.736084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:30.736824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:30.737683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:30.738298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:30.738870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:30.935870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:30.947798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d6b00452-bac1-4075-92c6-6b853ebcbde1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.227372 Aug 29 20:29:30.949250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 142/256] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:30 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:31.973582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:31.974661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:31.984031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:31.984564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:31.985008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:31.985725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:31.986183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:31.987236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:32.130753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:32.139483 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-eb909d3a-5666-42b8-8878-cbc6bb11174f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.172433 Aug 29 20:29:32.140240 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 143/257] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:31 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:33.161021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:33.162585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:33.170432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:33.171103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:33.171640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:33.172462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:33.173035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:33.173528 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:33.330377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:33.348344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:33.356717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f3223023-8a30-4cb6-88f8-7349708609b5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.196895 Aug 29 20:29:33.357828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 144/258] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:33 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:33.757557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=15 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:34.380594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:34.381213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:34.387923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:34.388457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:34.393691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:34.393691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:34.393691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:34.393691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:34.537619 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:34.547732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b6e45bd2-bff5-4552-8004-e6e93379e414 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.173407 Aug 29 20:29:34.561114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 145/259] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:34 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:34.847561 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:35.570035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:35.570649 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:35.583357 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:35.584082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:35.584719 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:35.589016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:35.589714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:35.594780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:35.775196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:35.784081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ef2897cb-cc1e-4037-9944-911fab193530 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1722 microversion: 2.1 time: 0.218993 Aug 29 20:29:35.784787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 146/260] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:35 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:36.302886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] validate_networks() for [('0b32b458-e224-4b4c-8df7-a9ce6fdf0867', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:29:36.809108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:36.809892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:36.824145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:36.827371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:36.828048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:36.829091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:36.829789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:36.830467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:37.051258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:37.065971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:29:37.066392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:29:37.067129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:29:37.067465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:29:37.067869 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:29:37.086189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e43e8d84-4257-4c3a-8599-8d257d96d0a4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1699 microversion: 2.1 time: 0.266803 Aug 29 20:29:37.086189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 147/261] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:36 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1699 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:37.086362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:37.086362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:37.086362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:37.086362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:37.086712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:37.092102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:37.095827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:37.107846 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:37.108470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:37.108927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:37.204698 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Going to try to start instance {{(pid=121467) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:29:37.339974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:37.350449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Getting quotas for user 336345e5437341ba9859d776c44ea4be and project 66be3e70cbf742269fe9306a7b7e8fe0. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:37.375856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:29:37.378645 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:29:37.549037 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b4a770f1-68f6-4fa0-8650-cfdaa2c0ca7d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 13.806041 Aug 29 20:29:37.549670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 115/262] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:29:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 13807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:29:37.560821 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0a234ba6-9e7c-4d6b-ac17-e5b380ee26a1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:37.561435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0a234ba6-9e7c-4d6b-ac17-e5b380ee26a1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:37.631291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:37.673168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0a234ba6-9e7c-4d6b-ac17-e5b380ee26a1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:37.683936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0a234ba6-9e7c-4d6b-ac17-e5b380ee26a1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1244 microversion: 2.1 time: 0.127222 Aug 29 20:29:37.685416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 116/263] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:37 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1244 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:37.739424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-716f26eb-69af-4776-b597-1453130e9dd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action" status: 202 len: 0 microversion: 2.1 time: 0.651566 Aug 29 20:29:37.740260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 148/264] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:29:37 2022] POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:29:37.750211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:37.750838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:37.766981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:37.769941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:37.771665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:37.773872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:37.774624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:37.779046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:38.028474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:38.038182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0e226f65-70f8-4ae1-a013-0cd2ca59eb33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1708 microversion: 2.1 time: 0.292676 Aug 29 20:29:38.039452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 117/265] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:37 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1708 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:38.706310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e3166738-0e60-4a76-9ca4-493014a53cee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:38.707002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e3166738-0e60-4a76-9ca4-493014a53cee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:38.769875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e3166738-0e60-4a76-9ca4-493014a53cee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:38.792279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e3166738-0e60-4a76-9ca4-493014a53cee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1244 microversion: 2.1 time: 0.079572 Aug 29 20:29:38.792279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 149/266] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:38 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:39.059753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:39.060442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:39.066758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:39.067985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:39.067985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:39.075603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:39.075603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:39.075603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:39.342399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:39.363310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d50997fc-9750-4d2a-8816-7ff06f67b5ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1708 microversion: 2.1 time: 0.307474 Aug 29 20:29:39.364215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 118/267] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:39 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1708 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:39.811399 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:39.812580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:39.823285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:39.823781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:39.824241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:39.824954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:39.825408 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:39.825835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:39.909761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:39.915281 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e347962b-a39d-4772-acb2-0b582497554b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1296 microversion: 2.1 time: 0.116267 Aug 29 20:29:39.920622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 150/268] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:39 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:40.388045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:40.389615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:40.396658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:40.397709 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:40.398372 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:40.399255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:40.399866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:40.400540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:40.622629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:40.631900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bbb2b58b-4f3e-4b74-8916-b6fe658e9114 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1708 microversion: 2.1 time: 0.250713 Aug 29 20:29:40.632933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 119/269] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:40 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:40.936932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:40.937565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:40.944868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:40.945365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:40.945805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:40.946510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:40.946965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:40.947914 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:41.027406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:41.036404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1bb12894-25f1-4bcd-a230-a3dd6fadbe85 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1296 microversion: 2.1 time: 0.103159 Aug 29 20:29:41.044866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 151/270] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:40 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:41.661340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:41.662158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:41.668857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:41.669349 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:41.669787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:41.670487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:41.671290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:41.671708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:41.920771 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:41.934095 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-eba6e4cd-d0db-47d7-9da2-da8e86156387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1712 microversion: 2.1 time: 0.284492 Aug 29 20:29:41.954807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 120/271] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:41 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1712 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:42.057688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:42.058317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:42.071363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:42.071865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:42.072364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:42.073082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:42.073543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:42.073971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:42.174080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:42.183127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d8ea52cb-0b9a-48cb-937e-55d0fce168e8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1314 microversion: 2.1 time: 0.129667 Aug 29 20:29:42.184404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 152/272] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:42 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1314 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:42.770241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-341329536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-105915495", "security_groups": [{"name": "tempest-secgroup-smoke-523439352"}], "networks": [{"uuid": "911800d0-96ca-449c-89af-c1239ce0898d"}], "block_device_mapping_v2": [{"uuid": "9e32a376-aa9d-46ec-aa6e-7b572e08d683", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:43.019763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] validate_networks() for [('911800d0-96ca-449c-89af-c1239ce0898d', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:29:43.207408 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:43.208221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:43.218940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:43.219589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:43.228446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:43.229947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:43.230532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:43.231118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:43.396672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:43.405892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-165f2f73-ac3d-4bca-9fec-72c06afe5b76 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.202686 Aug 29 20:29:43.420817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 153/273] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:43 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:44.101657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:29:44.102841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:29:44.104363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:29:44.105971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:29:44.105971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:29:44.115329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:44.115941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:44.116654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:44.117621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:44.118296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:44.118923 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:44.141127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Getting quotas for project 8c28205e89c1441bbb3f1d68ac8893e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:44.145651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Getting quotas for user 95d668bfaf71417baac3c4336c33ed9f and project 8c28205e89c1441bbb3f1d68ac8893e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:44.219339 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:29:44.221541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e32a376-aa9d-46ec-aa6e-7b572e08d683',volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:29:44.428021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:44.428672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:44.448925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:44.450760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:44.454368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:44.454368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:44.454368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:44.454368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:44.684536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:44.698260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4ecb3439-3f0e-4ecf-be1e-99a0d040b170 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.273388 Aug 29 20:29:44.699610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 154/274] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:44 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:44.752242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:44.788867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:44.789934 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:44.790858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:44.823260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] Creating event network-changed:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:29:44.839618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-47806223-4344-494a-b997-201ab8ce245d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.112468 Aug 29 20:29:44.839618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 121/275] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:29:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:29:44.840919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6513aa2a-8e96-4f62-88a2-1e6e6f1f6861 req-1f62b3a5-e76f-415c-84d0-48a09b010c11 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092367 Aug 29 20:29:44.841984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 155/276] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:44.856238 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7a639a25-f0fb-4379-857a-5a5a4a5d09c5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:44.866004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7a639a25-f0fb-4379-857a-5a5a4a5d09c5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:45.063807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7a639a25-f0fb-4379-857a-5a5a4a5d09c5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:45.063807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7a639a25-f0fb-4379-857a-5a5a4a5d09c5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1087 microversion: 2.1 time: 0.215992 Aug 29 20:29:45.065809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 122/277] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:44 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1087 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:45.721520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:45.727463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:45.750741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:45.756788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:45.756788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:45.758076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:45.759081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:45.761692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:46.020865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:46.031082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f40c854d-6181-47c3-9db9-8d85a4ff1300 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.315012 Aug 29 20:29:46.043177 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 156/278] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:45 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:46.085819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-262d7158-880e-447d-8574-d3f191d97596 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:46.087125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-262d7158-880e-447d-8574-d3f191d97596 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:46.165877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-262d7158-880e-447d-8574-d3f191d97596 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:46.176551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-262d7158-880e-447d-8574-d3f191d97596 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1087 microversion: 2.1 time: 0.095067 Aug 29 20:29:46.196621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 123/279] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:46 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1087 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:47.053347 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:47.054701 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:47.062197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:47.068363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:47.068363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:47.068363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:47.068363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:47.068872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:47.200464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:47.201070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:47.204948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:47.209197 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:47.209762 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:47.210210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:47.211047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:47.211529 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:47.211923 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:47.214507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e0a43ced-e8ed-4a0c-9b61-42f2676ebe55 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.165100 Aug 29 20:29:47.215576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 157/280] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:47 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:47.304377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:47.312969 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-18a167c5-ec5c-4533-9839-2f8377922410 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1137 microversion: 2.1 time: 0.117491 Aug 29 20:29:47.313736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 124/281] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:47 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1137 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:48.238611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:48.240019 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:48.247161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.247856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.248486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.249366 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.250000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.250424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.334229 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:48.335455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:48.342741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.344511 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.345181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.345893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.346356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.346778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.409723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:48.417358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-089a47c3-99b4-4981-8aee-ea63fe46b503 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.182461 Aug 29 20:29:48.428368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 158/282] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:48 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:48.432330 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:48.440862 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cb04db61-288e-4664-9050-11f29372b02d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1137 microversion: 2.1 time: 0.110504 Aug 29 20:29:48.445029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 125/283] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:48 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:48.616423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:48.617165 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:48.624385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.625088 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.625695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.626575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:48.627136 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:48.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:48.654845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bffe72ee-91fd-4be0-8b19-566245a9f197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/ips" status: 200 len: 153 microversion: 2.20 time: 0.043279 Aug 29 20:29:48.661701 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 159/284] 10.222.0.85 () {60 vars in 1289 bytes} [Mon Aug 29 20:29:48 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:29:49.440094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:49.440754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:49.446940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:49.447568 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:49.447999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:49.448733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:49.449189 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:49.449608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:49.465556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:49.467898 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:49.468476 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:49.484483 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:49.485249 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:49.485694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:49.486420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:49.486862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:49.487287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:49.569689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:49.595959 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-52bc0c0c-3f63-41b8-b75f-a3f97d76a690 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1137 microversion: 2.1 time: 0.134922 Aug 29 20:29:49.599174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 160/285] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:49 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1137 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:49.671311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:49.679358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-060224e1-fbfd-4505-a70c-411b5a3ff3ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.243160 Aug 29 20:29:49.680120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 126/286] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:49 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:50.622403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:50.623911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:50.626348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:50.632379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:50.632992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:50.633539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:50.634238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:50.634722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:50.635142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:50.700456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:50.701131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:50.710224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:50.710721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:50.711163 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:50.712118 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:50.712827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:50.713266 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:50.721365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:50.729226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-01951617-781b-407b-b593-a1d913899fa9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1129 microversion: 2.1 time: 0.111052 Aug 29 20:29:50.730638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 161/287] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:50 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1129 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:50.903225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:50.915315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8a7a6522-4538-40ff-a920-5bc11d56dafe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.218742 Aug 29 20:29:50.919655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 127/288] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:50 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:51.750638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:51.751309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:51.757780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:51.758469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:51.758908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:51.759622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:51.760077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:51.760713 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:51.831820 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:51.841287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-83ef5864-5627-43fc-91a0-c3c2e786c671 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1185 microversion: 2.1 time: 0.094757 Aug 29 20:29:52.060279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 162/289] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:51 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:52.060881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:52.060881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:52.060881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:52.060881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:52.061498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:52.061498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:52.061498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:52.061498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:52.110058 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:52.118532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fa9b4d84-9e47-4b0d-aacc-468166163583 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.185571 Aug 29 20:29:52.119232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 128/290] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:51 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:52.515154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "name": "network-vif-plugged", "status": "completed", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:52.527882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:52.528400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:52.528842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:52.541684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] Creating event network-vif-plugged:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:29:52.546980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-ed8ffe80-fc70-4bc7-b34b-125aa4178d24 req-06c164d7-307c-4d87-a3b7-d01984eb71da service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043488 Aug 29 20:29:52.548089 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 163/291] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:52.771110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:52.771660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:52.785626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:52.816343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:52.816343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:52.816343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:52.816343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:52.828618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:52.828618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'flavor' on Instance uuid ebb79e74-0490-4071-80c8-c04cbea1da40 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:29:53.078710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:53.080118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:53.089249 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:53.089964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:53.090407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:53.091614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:53.092296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:53.092917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:53.161447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:53.169437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-316c18ff-9dea-47b9-81d7-3bcc3bf01cc9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1203 microversion: 2.1 time: 0.095550 Aug 29 20:29:53.170003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 164/292] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:53 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:53.174910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:53.175551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:53.183401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:53.184382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:53.185003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:53.185882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:53.186493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:53.186930 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:53.334502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:53.342298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d5abb4b6-fa60-4b48-aea5-cb7d8f220eba tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.171326 Aug 29 20:29:53.342861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 165/293] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:53 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:54.130446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=4 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:54.192186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8c535af4-d499-40ee-984e-66f561fd66e5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/action" status: 202 len: 0 microversion: 2.20 time: 1.426147 Aug 29 20:29:54.193450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 129/294] 10.222.0.85 () {62 vars in 1319 bytes} [Mon Aug 29 20:29:52 2022] POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/action => generated 0 bytes in 1429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:29:54.194403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:54.195226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:54.202859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:54.203563 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:54.207717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.207717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.210416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.211082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.211672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.212567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.212719 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.213365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.213489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.214042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.214163 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.214497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.479521 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:54.491398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-aa3d9d3e-926a-43d0-9548-90787c83cab5 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1270 microversion: 2.1 time: 0.301676 Aug 29 20:29:54.509488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 166/295] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:54 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:54.517815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:54.522979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:54.535726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.536308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.536798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.537570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:54.538023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:54.538494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:54.568878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:54.579443 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:54.580942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:54.582222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f943125a-b888-4e35-8742-a747cde94eb3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.383667 Aug 29 20:29:54.596849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 130/296] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:29:54 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:29:54.698039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:54.706131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9d6f2f47-49a4-4ca9-86ef-de04040ba026 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1369 microversion: 2.1 time: 0.195261 Aug 29 20:29:54.706710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 167/297] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:54 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:55.209045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2c7d75d2-f1b5-4ef7-a4e2-8517bc3ec5a0 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'create', calling method: .version_select at 0x7f89879f4160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-142280226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmDXKcplFw7agp/Y33qpeC8DkieUm1cPew+xTkJQgwV4KlhKj29y93905HeQk927KAjK3x/9WZ/Fgok2RQ0QmZI9PfBfevactHetzek70RLaYZvsIlRwbaEbXG8zWzvnw=="}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:55.228861 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-2c7d75d2-f1b5-4ef7-a4e2-8517bc3ec5a0 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Getting quotas for project 0931206111ba46198d58746f57266c23. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:55.232715 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-2c7d75d2-f1b5-4ef7-a4e2-8517bc3ec5a0 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Getting quotas for user e82c9e9f4ca742abb6531b3210be3776 and project 0931206111ba46198d58746f57266c23. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:55.351236 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2c7d75d2-f1b5-4ef7-a4e2-8517bc3ec5a0 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.145927 Aug 29 20:29:55.352816 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 131/298] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:29:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:55.411172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1953938945", "imageRef": "d5baee99-650a-4edd-8bb1-43fb8fa27e58", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-142280226", "networks": [{"uuid": "8a787380-f914-4a76-98e1-a82b0f459bfb"}]}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:55.469180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] validate_networks() for [('8a787380-f914-4a76-98e1-a82b0f459bfb', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:29:55.527621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:55.532452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:55.544669 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.545729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.546333 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.554359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.554842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.555282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.823198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:55.831237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-22dcd189-af42-48de-8dcc-56c66fe9d33d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1270 microversion: 2.1 time: 0.316658 Aug 29 20:29:55.831806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 132/299] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:55 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1270 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:55.836481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:55.837117 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:55.843489 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.844227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.844735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.845610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.846230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.846659 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.894959 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:29:55.895382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:29:55.897000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:29:55.897000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:29:55.897000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:29:55.907695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.908659 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.909108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.909873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:55.910518 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:55.910951 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:55.918263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:55.928887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Getting quotas for project 0931206111ba46198d58746f57266c23. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:29:55.933029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Getting quotas for user e82c9e9f4ca742abb6531b3210be3776 and project 0931206111ba46198d58746f57266c23. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:29:55.945250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:29:55.948147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5baee99-650a-4edd-8bb1-43fb8fa27e58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:29:56.048029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:56.051660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:56.053115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:56.054280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7f1fd8fb-efa8-4803-abda-c9370de19664 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.221360 Aug 29 20:29:56.054834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 133/300] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:29:55 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:29:56.059139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:56.059735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:56.065792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.066269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.066730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.067499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.067955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.068408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.078671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8d0fdb42-3941-4967-b6c5-bfaa83406d6b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671285 Aug 29 20:29:56.079318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 168/301] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:29:56.090280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bbca202d-5a57-4bac-86a0-87a62fd7a2ab tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:56.091012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bbca202d-5a57-4bac-86a0-87a62fd7a2ab tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:56.166557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bbca202d-5a57-4bac-86a0-87a62fd7a2ab tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:56.174164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bbca202d-5a57-4bac-86a0-87a62fd7a2ab tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1258 microversion: 2.1 time: 0.088068 Aug 29 20:29:56.174925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 169/302] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:56 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:56.308405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:56.311901 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:56.316468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3224d4c5-2987-4c30-a096-2fdc01cee317 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1562 microversion: 2.1 time: 0.260670 Aug 29 20:29:56.317220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 134/303] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:56 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:56.336668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:56.337154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:56.343670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.344152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.344610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.345414 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.345869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.346286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.424910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-98d8e7db-7cfb-47d6-a241-612b9fc55c38 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091810 Aug 29 20:29:56.425613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 170/304] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:29:56 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:56.565386 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:56.577206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.578021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.578830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.593026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] Creating event network-changed:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:29:56.599034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-753306d8-7b5f-4c9b-b9c9-557c394d3ae3 req-7992fb65-5547-4b76-bff9-757f5b6d9686 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041881 Aug 29 20:29:56.600280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 135/305] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:29:56.854203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:56.854819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:56.861833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.862314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.862746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:56.863438 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:56.863886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:56.864346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:57.003439 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:57.011243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2a679600-b3e6-4e4a-9e17-9fea37c040b4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.161667 Aug 29 20:29:57.011906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 171/306] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:56 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:57.079391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:57.080126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:57.086336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:57.086821 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:57.087262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:57.088573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:57.088970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:57.089396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:57.195561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ac8aecb6-f86e-4051-8353-a0e4f62ee3bd tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:57.196196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ac8aecb6-f86e-4051-8353-a0e4f62ee3bd tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:57.250714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ac8aecb6-f86e-4051-8353-a0e4f62ee3bd tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:57.258092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ac8aecb6-f86e-4051-8353-a0e4f62ee3bd tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1258 microversion: 2.1 time: 0.066782 Aug 29 20:29:57.258781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 172/307] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:57 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:57.482896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:57.491405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:57.492867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:57.494105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-56d0f450-f654-42c3-8749-664a27a28901 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.419273 Aug 29 20:29:57.494653 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 136/308] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:29:57 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:29:58.037127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:58.037771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:58.045175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.045666 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.046135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.046832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.047293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.047723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.198291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:58.206504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-57f32510-6909-4233-b519-31198c45e389 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.173382 Aug 29 20:29:58.207086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 173/309] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:58 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:58.281218 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:58.283979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:58.288963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.289449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.289884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.290581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.291531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.291957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.354441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:58.362148 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-11f82c9b-d7a9-4d50-8e2a-5b38d4bc4820 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1262 microversion: 2.1 time: 0.085768 Aug 29 20:29:58.362713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 137/310] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:58 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:58.518692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:58.519442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:58.526908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.527750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.528238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.528963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.529443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.529923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.628728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:29:58.638153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:58.638866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:58.639297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:58.651718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] Creating event network-changed:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:29:58.657237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-78674cbc-e294-400e-aea0-074f5b7e29ac req-be2d5ad5-f9cc-4a24-8ef8-4cd0e15e7225 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Aug 29 20:29:58.658376 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 138/311] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:29:58.671375 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:58.688921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:58.688921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:58.688921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-474f3a3b-7ffe-48d2-9661-1ce702cbbfa8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.168968 Aug 29 20:29:58.689208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 174/312] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:29:58 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:29:59.227829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:59.228772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:59.236975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.237464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.268643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.268643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.268643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.268643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.374830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:59.382719 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:59.383244 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9aff4c3e-fe03-4baf-8e7b-ecda53af910f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.159591 Aug 29 20:29:59.383361 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:59.383507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 139/313] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:59 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:29:59.390589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.391071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.391508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.392216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.392671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.393091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.453003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:59.461029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a406529e-aad4-42a1-a614-47c76729e4fa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1254 microversion: 2.1 time: 0.082176 Aug 29 20:29:59.461600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 175/314] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:29:59 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:29:59.706884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:29:59.707493 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:29:59.714247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.714727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.715165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.715849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:29:59.716337 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:29:59.716765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:29:59.843851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:59.852410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:59.853904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:29:59.855045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-68fe6610-97db-41f9-98bc-fefd1ef0df54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.152064 Aug 29 20:29:59.855605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 140/315] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:29:59 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:00.403717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:00.404358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:00.410814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.411296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.411736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:00.412447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.412904 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.413331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:00.482810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:00.483554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:00.486629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:00.490239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.490796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.491307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:00.492080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.492635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.493060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:00.543561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:00.551316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5d92484f-2642-4580-8772-3f292897dedb tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.151568 Aug 29 20:30:00.551862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 176/316] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:00 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:00.555735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:00.563980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-17789e57-c7ec-4bd3-bb55-bdf07610d269 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1254 microversion: 2.1 time: 0.085615 Aug 29 20:30:00.564573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 141/317] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:00 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1254 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:00.878032 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:00.878736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:00.885604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.886083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.886549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:00.887235 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:00.887765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:00.888160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:01.017416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:01.026355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:01.027791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:01.028974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-00bf9db6-1585-4a91-b9c4-14f1aded6ff4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.154950 Aug 29 20:30:01.029533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 177/318] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:00 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:01.573841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:01.574375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:01.580523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:01.581001 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:01.581442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:01.582123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:01.582576 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:01.583003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:01.584983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:01.585607 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:01.592417 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:01.593276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:01.594055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:01.594940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:01.595394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:01.595817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:01.665555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:01.674770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-80ab91a1-f3af-4c5d-a84e-6fe202747957 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1254 microversion: 2.1 time: 0.093790 Aug 29 20:30:01.675828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 178/319] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:01 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1254 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:01.774168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:01.781834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d4b94399-5bb3-47ef-8f23-12c9104f75e9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.212878 Aug 29 20:30:01.782405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 142/320] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:01 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:02.053022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:02.053752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:02.059993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.060517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.060960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.061696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.062151 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.062575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.200554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:02.209998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:02.219763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:02.219763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-cfdb90af-cab5-482f-aae8-894d68a33b42 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.165337 Aug 29 20:30:02.219763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 179/321] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:02 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:02.695948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:02.696582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:02.702419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.702894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.703323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.703995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.704490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.704895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.773950 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:02.781891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-76ee0262-a0ce-42f9-9559-477e05ed0263 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1310 microversion: 2.1 time: 0.089812 Aug 29 20:30:02.782470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 143/322] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:02 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:02.802886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:02.803527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:02.810745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.811233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.811661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.812406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:02.813031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:02.813456 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:02.946058 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:02.953926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-89362486-c5f4-4e5a-b037-01b2700a136d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.154948 Aug 29 20:30:02.954516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 180/323] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:02 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:03.238506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:03.239223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:03.245621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.246100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.246529 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:03.247209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.248010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.248450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:03.470944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:03.480032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:03.481524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:03.482696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-63c2f428-eb6a-4367-bc23-f090a14f48b1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.249058 Aug 29 20:30:03.483276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 144/324] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:03 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:03.802842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:03.803446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:03.810902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.811388 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.811824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:03.812541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.812993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.813412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:03.877590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:03.885348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4a20937d-e004-47fd-9560-9eae29dfc647 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1316 microversion: 2.1 time: 0.086367 Aug 29 20:30:03.885917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 181/325] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:03 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:03.975638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:03.977901 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:03.986315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.987016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.987371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:03.988289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:03.988752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:03.989291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:04.320375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:04.333299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e6a89589-f770-4591-8302-e2ec834fcf2a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.362126 Aug 29 20:30:04.339170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 145/326] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:03 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:04.506954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:04.507568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:04.514823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:04.515571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:04.516400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:04.521407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:04.522210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:04.522956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:04.684649 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:04.692845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:04.694540 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:04.696839 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3e8adb19-26fc-4007-8c1e-dc012823c023 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.193681 Aug 29 20:30:04.697601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 182/327] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:04 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:04.907375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:04.907985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:04.914109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:04.914585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:04.915020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:04.915725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:04.916193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:04.916612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:05.062207 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:05.069974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-158baf74-3a75-4591-847e-9ff22ca4eba8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.166360 Aug 29 20:30:05.070465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 146/328] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:04 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:05.355018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:05.355588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:05.362264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:05.367229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:05.367229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:05.367229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:05.367229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:05.367604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:05.520581 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:05.529306 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ab65904e-94a5-46b8-a23b-15d141c3d8fd tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.179151 Aug 29 20:30:05.532724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 183/329] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:05 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:05.720367 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:05.720906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:05.722761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=22 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:05.727972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:05.729117 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:05.729620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:05.730414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:05.730967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:05.731390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:05.904673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:05.913857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:05.916758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:05.918198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-249d6ea7-9f11-4313-8e65-08f75de13686 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.201918 Aug 29 20:30:05.918757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 147/330] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:05 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:06.091814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:06.092581 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:06.094688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:06.109038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.109038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.128741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:06.128741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.128741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.128741 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:06.253314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:06.262146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e02dde4-4d37-41fa-bf0f-7855f0ff2394 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.175188 Aug 29 20:30:06.262719 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 184/331] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:06 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:06.549744 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:06.550288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:06.557030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.557520 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.558127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:06.558833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.559278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.559701 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:06.702787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:06.710562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c42e3dde-df0e-4edd-99f2-14a966b91a94 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.164712 Aug 29 20:30:06.711131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 148/332] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:06 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:06.941653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:06.942258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:06.949365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.949858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.950287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:06.950975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:06.951603 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:06.952205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:07.096242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:07.101405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:07.102850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:07.104041 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c9c37053-a7aa-4540-b875-c0a607a2ea27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.166536 Aug 29 20:30:07.104628 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 185/333] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:06 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:07.282720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:07.283330 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:07.289728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:07.290263 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:07.290699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:07.291397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:07.292030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:07.292479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:07.427419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:07.436671 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-982c8e20-e16f-401e-9d2b-922f68935eaf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.157681 Aug 29 20:30:07.437297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 149/334] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:07 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:07.732419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:07.733294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:07.736981 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=10 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:07.741764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:07.742239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:07.742674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:07.743370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:07.743822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:07.744510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:07.884192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:07.895202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0e9903f7-855d-4ee3-a0d3-a0656034a5d0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.167165 Aug 29 20:30:07.896118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 186/335] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:07 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:08.127328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:08.128017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:08.135120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.138899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.138899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:08.138899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.138899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.139277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:08.277440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:08.287397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:08.288884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:08.290088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f314d500-a830-43e6-9a9e-e2c13411ab86 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.166869 Aug 29 20:30:08.290712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 150/336] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:08 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:08.458502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:08.459832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:08.467331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.467824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.468279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:08.470989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.471458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.471891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:08.624367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:08.626655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:08.632828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5d5bfa4e-73d5-4ee8-9250-20a61371556a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.178758 Aug 29 20:30:08.633521 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 187/337] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:08 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:08.923313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:08.927041 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:08.946809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.946809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.946809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:08.946809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:08.947240 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:08.947240 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:09.093434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:09.101314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cc0c952e-65e7-4c19-8753-80848327df22 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.188266 Aug 29 20:30:09.101881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 151/338] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:08 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:09.313731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:09.314468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:09.321426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:09.322817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:09.323333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:09.324117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:09.324678 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:09.325179 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:09.513874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:09.523530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:09.525119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:09.526346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8f1d6b71-99b1-4255-a611-7d7a1e3e06e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.217003 Aug 29 20:30:09.526975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 188/339] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:09 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:09.660604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:09.661350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:09.680308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:09.680832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:09.682267 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:09.682999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:09.683449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:09.683919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:09.825893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:09.829812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:09.837182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3c06b542-78b5-4f01-a171-e0177efaf6a7 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.187823 Aug 29 20:30:09.838960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 152/340] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:09 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:10.126503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:10.127393 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:10.133638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.134791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.135304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:10.136103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.136558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.137102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:10.318672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:10.328080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-852cd48f-9713-45e2-b9cf-2a6c2e4ac90f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.210073 Aug 29 20:30:10.328919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 189/341] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:10 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:10.550389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:10.551392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:10.561685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.562447 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.563062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:10.563941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.568317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.568957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:10.773824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:10.775538 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:10.777011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:10.778171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-807d857d-03a3-4e98-98d0-1870fad8408a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.232068 Aug 29 20:30:10.778716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 153/342] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:10 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:10.863286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:10.863286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:10.867818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.868460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.869051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:10.869862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:10.870496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:10.871143 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:11.018707 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:11.031562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fa73fd4a-4f11-4734-bcf4-80fcf1019317 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.176231 Aug 29 20:30:11.032060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 190/343] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:10 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:11.360660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:11.361556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:11.376569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:11.376569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:11.376569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:11.376569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:11.377432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:11.377432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:11.557842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:11.566627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2ce447b1-d9ef-4e5a-b493-9608de57a2c0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.210874 Aug 29 20:30:11.567216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 154/344] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:11 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:11.804683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:11.806004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:11.813149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:11.813723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:11.816731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:11.817621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:11.817965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:11.818406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:11.990300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:11.999802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:12.001353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:12.002734 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dd753ed6-ae42-44fc-bcc3-c3c8d66cde0d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.204631 Aug 29 20:30:12.003295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 191/345] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:11 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:12.053510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:12.054146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:12.060958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:12.061464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:12.061871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:12.062566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:12.063019 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:12.063492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:12.202993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:12.211104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1b65d9d8-0b4d-4e87-bfa6-ed19d29d940f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.162629 Aug 29 20:30:12.218152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 155/346] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:12 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:12.588119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:12.588991 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:12.595182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:12.595754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:12.596284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:12.597342 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:12.597867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:12.598287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:12.802945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:12.818035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-16f5ba21-6464-4999-935f-25dd67247b9e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.234374 Aug 29 20:30:12.828223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 192/347] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:12 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:13.025850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:13.026587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:13.033221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.034019 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.034641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:13.035519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.036247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.036872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:13.177368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:13.186802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:13.188515 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:13.189731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-db9768ab-0613-473d-89c4-629de3d9c8a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.167927 Aug 29 20:30:13.190314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 156/348] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:13 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:13.233270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:13.233944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:13.240689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.241441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.242053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:13.242753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.243208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.244293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:13.381371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:13.389726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d7c2c5c7-5fb1-4471-a4cd-5bd3729b179e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.161673 Aug 29 20:30:13.390298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 193/349] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:13 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:13.842401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:13.842954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:13.861458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.862045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.862654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:13.863466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:13.864433 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:13.865364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:14.213396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:14.214188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:14.220537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:14.221298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:14.221721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:14.222423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:14.222873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:14.223570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:14.251887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:14.260358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-79f6cc30-3695-462e-b691-d898fc5e12a0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.422325 Aug 29 20:30:14.260940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 157/350] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:13 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:14.358795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:14.371387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:14.374638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:14.376156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5d6973cf-880f-4dce-816e-4ef1d40662ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.167186 Aug 29 20:30:14.377162 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 194/351] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:14 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:14.414279 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:14.414887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:14.421178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:14.421660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:14.422093 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:14.422776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:14.423225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:14.423642 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:14.569961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:14.579877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-80a4f840-69a2-42de-b8db-4a3486929cb8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.172572 Aug 29 20:30:14.580595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 158/352] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:14 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:15.282012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:15.282614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:15.289104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.289639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.290068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.291360 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.291806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.292245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.401215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:15.401844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:15.407760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.408304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.408742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.409430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.409871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.410288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.431717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:15.442881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d416586c-5e20-4ab6-94aa-f6266dbad05d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.164247 Aug 29 20:30:15.442881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 195/353] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:15 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:15.603367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:15.603986 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:15.611004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.611502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.611933 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.612654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.613105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.613520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.631951 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:15.642062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:15.643527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:15.644741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8e8ef036-8118-496b-ba72-8cb403373e5a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.248376 Aug 29 20:30:15.645718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 159/354] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:15 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:15.755409 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:15.763706 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6a09c2a5-aff2-4c37-a83c-f359e04dd5f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.164369 Aug 29 20:30:15.764801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 196/355] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:15 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:15.881825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:15.891473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:15.891950 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:15.892409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:15.904944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] Creating event network-changed:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:30:15.910038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-12de8139-1e7b-4250-8445-4588bb000301 req-dfc6ffec-d8e8-4048-bf77-677c604bf06e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032772 Aug 29 20:30:15.910884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 160/356] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:16.463482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:16.464284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:16.470927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.471539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.472045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.473006 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.473541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.474038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.619313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:16.628083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-acd62715-66e4-4143-ad30-923ad9d2f734 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.169036 Aug 29 20:30:16.628848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 197/357] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:16 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:16.669842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:16.671156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:16.677269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.677952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.678614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.679316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.679763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.680201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.799827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:16.807117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:16.811687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.812679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.813608 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.814534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:16.815380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:16.816716 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:16.972023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:16.984893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:16.987276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:16.988958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-82f546c4-eeab-4e56-bdfa-588aea96c289 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1747 microversion: 2.20 time: 0.323900 Aug 29 20:30:16.989902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 161/358] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:16 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1747 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:16.991952 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:16.995296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-89259217", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "networks": [{"uuid": "0a8039e6-65a9-4c56-8616-376af6d97efa"}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:16.999963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6facb976-3394-4cb0-b2de-00758b60f227 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.218965 Aug 29 20:30:17.008205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 198/359] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:16 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:17.070128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] validate_networks() for [('0a8039e6-65a9-4c56-8616-376af6d97efa', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:30:17.649337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:17.650547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:17.657026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:17.657509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:17.658107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:17.658964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:17.659583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:17.660188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:17.711852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:30:17.712760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:30:17.712931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:30:17.713225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:30:17.713634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:30:17.722517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:17.722994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:17.723423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:17.724145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:17.724621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:17.725045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:17.742929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Getting quotas for project ac65a0d70d7045d183a8a725b304c169. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:30:17.747704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Getting quotas for user 83efc8c932d04432ad3d0c974e0333a9 and project ac65a0d70d7045d183a8a725b304c169. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:30:17.758430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:30:17.761087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:30:17.802132 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:17.811879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-592b63ca-0965-4bc3-8286-6e6e5a0e641b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.166702 Aug 29 20:30:17.812471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 199/360] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:17 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:17.910522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3848fb61-e9ac-41d5-82c4-00d73b0d47da tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919323 Aug 29 20:30:17.911678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 162/361] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:30:17.922583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c84ef7c2-7063-4a83-9080-e63adfa66ef2 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:17.923549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c84ef7c2-7063-4a83-9080-e63adfa66ef2 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:17.959214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:18.011582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c84ef7c2-7063-4a83-9080-e63adfa66ef2 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.014243 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:18.014834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:18.026882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.027331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.031751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c84ef7c2-7063-4a83-9080-e63adfa66ef2 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1217 microversion: 2.1 time: 0.112978 Aug 29 20:30:18.032396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 200/362] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:17 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:18.036631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.042781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.042781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.042781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.101261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:18.105479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:18.143847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.143847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.143847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.143847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.144209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.144209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.272230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.289281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.291052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.292455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-46e3bf0b-7228-4472-81ac-fb1268a7d7ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1747 microversion: 2.20 time: 0.282496 Aug 29 20:30:18.293507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 163/363] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:18 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1747 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:18.385443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.393178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c33b020d-bb41-4383-8360-06a0e63aec95 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.304772 Aug 29 20:30:18.393780 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 201/364] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:18 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:18.833111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:18.833919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:18.840157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.840778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.841331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.842082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:18.842603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:18.843101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:18.973548 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:18.981567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-492b0edf-ffba-4b1d-8358-2f116309df3e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.152399 Aug 29 20:30:18.982139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 164/365] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:18 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:19.053101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-54192009-c07d-4775-ae94-8eb23c04b0d3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:19.053733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-54192009-c07d-4775-ae94-8eb23c04b0d3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:19.105833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-54192009-c07d-4775-ae94-8eb23c04b0d3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:19.112963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-54192009-c07d-4775-ae94-8eb23c04b0d3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1217 microversion: 2.1 time: 0.063713 Aug 29 20:30:19.119396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 202/366] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:19 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:19.315070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:19.315918 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:19.322829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:19.323387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:19.323826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:19.324604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:19.325258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:19.325684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:19.415110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:19.416150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:19.422397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:19.422890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:19.423325 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:19.424026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:19.424668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:19.425099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:19.487313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:19.497443 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:19.499804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:19.501990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e9a5d4ed-6ef8-41ea-a9c4-d83a06b644fe tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1747 microversion: 2.20 time: 0.190181 Aug 29 20:30:19.503093 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 165/367] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:19 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1747 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:19.575137 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:19.583062 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fc3c1780-e0a5-4198-a8fb-e0671f55332d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.173574 Aug 29 20:30:19.583626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 203/368] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:19 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:20.001837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:20.002452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:20.008382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.008860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.009298 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.009981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.010428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.010850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.134336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:20.135581 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:20.141824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.142313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.142754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.142856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.143451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.144070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.144538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.151620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e70d6cee-6343-4277-8d55-06b97d0d57ea tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.153584 Aug 29 20:30:20.152380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 166/369] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:19 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:20.209911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.218297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e6620343-1c28-4777-ab96-d62ddf26d6b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1221 microversion: 2.1 time: 0.088120 Aug 29 20:30:20.218864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 204/370] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:20 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:20.527621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:20.528352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:20.534716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.535319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.535923 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.536832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.537284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.537700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.604204 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:20.604959 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:20.611573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.612129 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.612784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.613691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.614296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.614874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.686184 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.694994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.697159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.698424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-191df4b7-ab8b-44df-ba1a-cef53a2a5d7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.175514 Aug 29 20:30:20.700543 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 167/371] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:20 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:20.764465 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:20.773830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a69e59cd-152a-4d32-895c-e31899a8667f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.173687 Aug 29 20:30:20.775903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 205/372] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:20 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:20.841624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "name": "network-vif-plugged", "status": "completed", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:20.853511 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:20.853996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:20.854592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:20.868344 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] Creating event network-vif-plugged:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:30:20.874312 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-5e9d5b21-3de4-4d19-9318-c77dd4b19fac req-e8447fbb-8c24-4bbf-8806-461a9dbababd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037576 Aug 29 20:30:20.874905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 168/373] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:21.184811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:21.184811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:21.189014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.192343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.193155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.195609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.198402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.199011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.233933 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:21.239495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:21.243081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:21.258930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.258930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.258930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.258930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.259598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.259598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.336868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:21.346263 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3a0c1d37-23ac-4634-b403-dba3f1c4a55f tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1269 microversion: 2.1 time: 0.110880 Aug 29 20:30:21.347630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 169/374] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:21 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:21.417533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:21.427855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-948ec23f-3636-47e9-a0cc-974d942f5089 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.254573 Aug 29 20:30:21.429532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 206/375] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:21 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:21.722187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:21.723199 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:21.747613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.748110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.748573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.749281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.749734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.750156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.796218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:21.813500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:21.813500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.813500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.813500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.813941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:21.813941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:21.813941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:21.981754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:21.999102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:22.005879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:22.008813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2bf9c4e1-90e7-42f7-8f10-8bded3dc9a8b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.288975 Aug 29 20:30:22.008813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 170/376] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:21 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:22.042886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:22.054503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-931f1871-3b47-43c6-bd13-bba47c0ed75b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.262728 Aug 29 20:30:22.068480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 207/377] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:21 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:22.368416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:22.370340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:22.377707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:22.378266 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:22.378773 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:22.379537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:22.380114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:22.380624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:22.406368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:22.453003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:22.453625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:22.454099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:22.462337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:22.462832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:22.463205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-908212c1-8290-41d4-a85f-6fddc49997fb tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1287 microversion: 2.1 time: 0.098679 Aug 29 20:30:22.463346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:22.463964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:22.464586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 171/378] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:22 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:22.477545 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:22.478150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:22.679260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:22.692925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a02f375b-7f4b-4a38-8dce-399e72f423cc tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.243702 Aug 29 20:30:22.693511 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 208/379] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:22 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:22.891281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "name": "network-vif-plugged", "status": "completed", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:22.919678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:22.920625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:22.921280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:22.954477 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] Creating event network-vif-plugged:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:30:22.960269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-0a2064a1-ea7b-4d2e-a0a9-bae6e7b2e04f req-da25e435-6937-46a5-9cdd-657b6b3bf456 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073838 Aug 29 20:30:22.962332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 172/380] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:30:23.031919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:23.032551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:23.043152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.043684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.044154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.049188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.049674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.050106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.076104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:23.077160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:23.085152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.085885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.086485 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.087377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.087982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.088598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.227110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.240060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.244823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.244823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-48ac4c97-d833-46da-a740-3bf43ebd1c9f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.215472 Aug 29 20:30:23.245617 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 209/381] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:23 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:23.282781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.292153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-27553c0c-9142-4a9f-b22e-f941363023aa tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.220460 Aug 29 20:30:23.293143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 173/382] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:23 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:23.487548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:23.489012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:23.496433 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.499613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.499613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.499613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.499613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.499974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.626926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.639976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-41249b8c-d913-47cd-a785-0fb33f946b43 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1275 microversion: 2.1 time: 0.158916 Aug 29 20:30:23.657702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 210/383] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:23 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:23.807011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:23.807011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:23.807011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.807011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.808331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.808331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:23.808331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:23.808331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:23.897477 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:23.906209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-38834ecb-da86-4823-a5a2-8bda47557bc3 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.195011 Aug 29 20:30:23.907105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 174/384] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:23 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:24.267954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:24.268588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:24.275304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.275796 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.276253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.276943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.277399 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.277825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.312534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:24.313135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:24.319076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.319559 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.319990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.320702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.321163 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.322268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.461103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:24.470610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-16d18470-f5cf-4f4d-a7ca-56369c50b9ae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.161810 Aug 29 20:30:24.471317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 175/385] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:24 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:24.579674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:24.589084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:24.590811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:24.592134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-297bd4f7-42ca-4618-b4ef-3e30cbd66fa3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.328042 Aug 29 20:30:24.592851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 211/386] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:24 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:24.664770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:24.665384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:24.671585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.672066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.672537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.673226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.673676 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.674099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.808103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:24.815744 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-aff1ffd3-4425-4060-9a39-e6b6ee801b7a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.154964 Aug 29 20:30:24.816343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 176/387] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:24 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:24.928443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:24.929205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:24.935680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.936158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.936618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:24.937296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:24.937742 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:24.938157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.094757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:25.105183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1997b7ff-3d7a-4557-9372-0d707d71e518 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1258 microversion: 2.1 time: 0.180537 Aug 29 20:30:25.107469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 212/388] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:24 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:25.171426 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "name": "network-vif-plugged", "status": "completed", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:25.187775 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.188637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.192955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.211178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] Creating event network-vif-plugged:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:30:25.217893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-e4d19cca-ed6a-4766-bb61-0a778e0d0f32 req-9cee1f11-4858-44f1-aa23-993e6fea6877 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052893 Aug 29 20:30:25.218791 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 177/389] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:25.492150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:25.492968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:25.502014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.502943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.503543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.504424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.505031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.505662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.618781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:25.619819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:25.633683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.634947 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.635485 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.636471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.638011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.639047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.712808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:25.733743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-80ae4b14-8a54-439d-a453-c00124b7851b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.245659 Aug 29 20:30:25.735466 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 213/390] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:25 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:25.837105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:25.838206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:25.847766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.848563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.850189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:25.854684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:25.855406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:25.856018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.011410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.021633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.023070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.024241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2ff52a58-e552-4512-a544-ea3673af8362 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.410740 Aug 29 20:30:26.025700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 178/391] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:25 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:26.050329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.066016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-eb5ac2ed-6bda-4940-8010-9e4a677c5005 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.233056 Aug 29 20:30:26.067460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 214/392] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:25 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:26.131866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:26.132494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:26.139371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.140342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.140342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.140944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.141392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.141826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.295153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5508dfc8-8be5-4b99-aa5d-0d4764f832ca", "tag": "aa326d67-2531-4f2a-9033-868d0d1708f2"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:26.307950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.309615 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.310044 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.329159 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] Creating event network-changed:aa326d67-2531-4f2a-9033-868d0d1708f2 for instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca on hv-cinder-85200 Aug 29 20:30:26.335963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-9aeec5e9-694e-46e4-992b-d8a443618b04 req-ca06d0c7-25ae-4ec2-8f1a-1214da0c4c9e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043808 Aug 29 20:30:26.337059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 215/393] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:26.342355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.363438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-81dad1fa-c016-4659-8d5e-903c1420f694 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1442 microversion: 2.1 time: 0.235251 Aug 29 20:30:26.364327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 179/394] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:26 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1442 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:26.390167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:26.391178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:26.399631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.400221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.405452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.411632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.411632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.411632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.572482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.581497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-48c206b1-7260-475e-a213-a4e14f857946 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1442 microversion: 2.1 time: 0.196221 Aug 29 20:30:26.582075 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 216/395] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:26 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1442 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:26.757829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:26.758843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:26.766827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.767341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.767785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.768511 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:26.769127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:26.770486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:26.973909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:26.989370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-828ec647-a56c-42e2-97cc-2f667731ceb2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1358 microversion: 2.1 time: 0.235389 Aug 29 20:30:26.990686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 180/396] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:26 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:27.058535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:27.059263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:27.072999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:27.073843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:27.074496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:27.075420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:27.077449 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:27.078231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:27.092973 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:27.094182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:27.108301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:27.108798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:27.109233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:27.109942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:27.110505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:27.110824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:27.386268 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:27.400786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:27.405839 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:27.406641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-545d4da3-1148-4a95-a5b2-7dfdf4e063f7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.352262 Aug 29 20:30:27.407742 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 217/397] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:27 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:27.414160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:27.432208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3268778a-aff8-43aa-b058-4bceb3e7e84b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.343831 Aug 29 20:30:27.437582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 181/398] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:27 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:28.031585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:28.032299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:28.066174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.071351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.072726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.073708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.080823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.081655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.366238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.376139 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3fa8e2f9-db65-4a60-a340-94f65e144ef1 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1548 microversion: 2.1 time: 0.362738 Aug 29 20:30:28.376810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 218/399] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:28 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1548 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:28.404139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:28.404778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:28.406956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:28.407621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:28.412488 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.412981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.413420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.414115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.414732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.415663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.430721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:28.431870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:28.443859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.444405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.450971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.481856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.481856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.481856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.630032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.638325 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-af410f0b-7260-4f6e-8ae3-e9439c0168b5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1548 microversion: 2.1 time: 0.245392 Aug 29 20:30:28.638875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 182/400] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:28 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:28.643519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:28.644121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:28.654484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.660609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.660609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.660609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.660609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.661015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.797531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.808470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-74d30119-bac0-4d08-baad-cfc0a0209a18 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.168379 Aug 29 20:30:28.814651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 183/401] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:28 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:28.819371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.828285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:28.834223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.834383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.835005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Searching by: {'deleted': False, 'project_id': '0931206111ba46198d58746f57266c23'} {{(pid=121468) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 20:30:28.841083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:28.841790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:28.843493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-580aadb8-ebe6-45aa-a340-3a67832eccbf tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.416747 Aug 29 20:30:28.844059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.845464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.845464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.860413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 219/402] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:28 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:28.861110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:28.861110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:28.861110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:28.947686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.multi_cell_list [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121468) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 20:30:29.049768 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6c4475a0-5904-482b-919c-101364b9913a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225775 Aug 29 20:30:29.050593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 184/403] 10.222.0.85 () {58 vars in 1125 bytes} [Mon Aug 29 20:30:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:29.062016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:29.062640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:29.069387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.070742 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.071900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:29.072715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.073179 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.075253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:29.110610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:29.243074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:29.251362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5e926838-950c-4ad5-9692-7d4605b8465d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1548 microversion: 2.1 time: 0.193383 Aug 29 20:30:29.266504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 220/404] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:29 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:29.830269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:29.831502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:29.846242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.846732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.847176 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:29.847898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.852805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.852963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:29.877567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:29.879451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:29.898169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.900539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.903732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:29.906874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:29.908674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:29.909731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:30.080248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:30.096098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f4a99dda-18c8-4d7e-ac69-b14629d74c76 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.266759 Aug 29 20:30:30.096098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 185/405] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:29 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:30.135879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:30.157387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:30.159278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:30.161779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dbe8b609-e364-48ab-9276-573d2bf332d4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.288941 Aug 29 20:30:30.169989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 221/406] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:29 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:30.407164 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:30.417628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:30.418167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:30.418603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:30.449050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] Creating event network-changed:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:30:30.449050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-be603a9c-ac5b-4c7e-8799-25ee9a69003e req-079d1d5b-3942-4023-9262-694067ca83dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126114 Aug 29 20:30:30.449050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 186/407] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:31.113825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:31.114811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:31.126201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.129579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.130223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.131491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.132190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.132837 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.185954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:31.201316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:31.201316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.201316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.201316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.202549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.202549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.202930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.390168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:31.401162 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:31.412844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-433b2ad2-29e3-48a7-ab9d-5c42fd101fa7 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.302757 Aug 29 20:30:31.413898 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 222/408] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:31 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:31.414167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:31.416417 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:31.418985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fb3a4e61-bfc7-4219-a8cc-ee124922bc89 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.237007 Aug 29 20:30:31.418985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 187/409] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:31 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:31.901641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f896f0-6200-4d53-87d0-c3143c56b3c7"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:31.901641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:31.906971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.907452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.909226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.910193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:31.910826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:31.911270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:31.998766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:32.437125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:32.437970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:32.445742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.447043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.447660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:32.448506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.448984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.449463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:32.618299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:32.626533 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-00f09de6-ed27-435d-a121-5c9ea8fd7cd3 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.195910 Aug 29 20:30:32.627192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 188/410] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:32 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:32.631976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:32.632620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:32.639374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.639874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.640349 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:32.641059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.641519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.642076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:32.800728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:32.805066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:32.810503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:32.813547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:32.814741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-10a2c0f9-8e36-4277-899c-c8492df67ae5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.186426 Aug 29 20:30:32.815456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 189/411] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:32 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:32.950151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:32.950776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:32.957204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.957880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.958482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:32.959325 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:32.959920 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:32.960548 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:33.096235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'services' on Instance uuid 01cc3eff-660a-4cdb-93ec-9c5083607486 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:30:33.774908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ef23d43f-c878-46c0-a67a-e31e05c75c6c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments/ccb7e0c7-1ba6-4fdd-91d5-a3dae0bf4ee4" status: 202 len: 0 microversion: 2.1 time: 0.828903 Aug 29 20:30:33.775579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 190/412] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:30:32 2022] DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments/ccb7e0c7-1ba6-4fdd-91d5-a3dae0bf4ee4 => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:30:33.783857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:33.785018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:33.808625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:33.810410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:33.810410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:33.810410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:33.816209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:33.825897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:34.059856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:34.071072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-71f61c58-cd5b-46d1-bd4b-90df89de35dd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.292939 Aug 29 20:30:34.075015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 191/413] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:33 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:34.086827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:34.086827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:34.086827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:34.087756 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:34.088424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:34.089369 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:34.090038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:34.091507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:34.293396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:34.308862 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:34.310380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:34.311557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d8a2c759-0642-4773-af89-3544cea83370 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.235511 Aug 29 20:30:34.312128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 192/414] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:34 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:34.736764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f6d3b6c4-c72e-494f-8a71-4f1b32ae674e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.843647 Aug 29 20:30:34.737395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 223/415] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:30:31 2022] POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 194 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:35.095022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:35.098222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:35.105744 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:35.108510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:35.108741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:35.109461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:35.110032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:35.110459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:35.253609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:35.263428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cf951c25-feb3-4356-887b-d94974d71088 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.171015 Aug 29 20:30:35.263428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 193/416] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:35 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:35.402674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:35.403374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:35.411313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:35.411809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:35.412271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:35.412986 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:35.413440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:35.413862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:35.520886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5508dfc8-8be5-4b99-aa5d-0d4764f832ca", "name": "network-vif-plugged", "status": "completed", "tag": "aa326d67-2531-4f2a-9033-868d0d1708f2"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:35.530081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:35.530566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:35.531009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:35.543586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] Creating event network-vif-plugged:aa326d67-2531-4f2a-9033-868d0d1708f2 for instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca on hv-cinder-85200 Aug 29 20:30:35.548625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-b5f621bf-797e-4e4a-95ef-a78bb8c11d67 req-ffecbad4-db0d-4c8a-8ebc-10bfa771b285 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037300 Aug 29 20:30:35.552190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 194/417] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:35.565145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:35.574759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:35.586075 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:35.586075 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-77ad27f5-f239-4180-ad52-0cbbf9d0b46e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1742 microversion: 2.20 time: 0.181182 Aug 29 20:30:35.586075 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 224/418] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:35 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:35.993902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:36.000382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.001012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.001462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.026625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Going to try to stop instance {{(pid=121468) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:30:36.284986 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:36.285370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:36.292290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.292793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.298787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.298787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.298787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.298787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.335289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bca4b432-da98-40fd-adc9-4ab9169aa760 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action" status: 202 len: 0 microversion: 2.1 time: 0.338542 Aug 29 20:30:36.335289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 195/419] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:30:35 2022] POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:30:36.352194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:36.354177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:36.361692 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.363995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.363995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.363995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.363995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.364783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.463683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:36.471950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9f2c8e4f-9ded-4488-b5de-4a8d07954e75 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.192876 Aug 29 20:30:36.472565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 225/420] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:36 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:36.518545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:36.528757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-07c35caf-2639-4bc4-81cf-e509b6f506c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.188106 Aug 29 20:30:36.529331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 196/421] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:36 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:36.601854 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:36.602437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:36.610099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.610665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.611114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.611830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:36.612345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:36.612835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:36.751650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:36.762568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:36.764024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:36.767549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8576747c-91dc-44fd-8b50-0d18b647977d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1724 microversion: 2.20 time: 0.167740 Aug 29 20:30:36.768053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 226/422] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:36 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:37.493426 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:37.494175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:37.500362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.500972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.501407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.502915 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.503373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.503798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.550036 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:37.551261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:37.563597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.564252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.564775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.567530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.568015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.569186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.721308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:37.724568 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:37.733003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-40bd828f-7e3c-4a5c-aca6-33fe755be200 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.186811 Aug 29 20:30:37.734010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 227/423] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:37 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:37.737006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c0f0c130-1531-4271-b3ca-c6f53f533204 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1317 microversion: 2.1 time: 0.248157 Aug 29 20:30:37.740792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 197/424] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:37 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:37.790706 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:37.791397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:37.797601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.798219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.798679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.799371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:37.799818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:37.800277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:37.939149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:37.949947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:37.951639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:37.952868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ce860d98-1cb1-4349-8b11-320b4dc98155 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1724 microversion: 2.20 time: 0.166260 Aug 29 20:30:37.953423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 228/425] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:37 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:38.757050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:38.757762 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:38.763031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:38.763661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:38.764148 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.764765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.765203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:38.765898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.766351 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.766772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:38.770679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.771157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.771643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:38.772462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.772913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.773696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:38.911932 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:38.917402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:38.925523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e9d1fc4b-5e5a-48e4-b589-fc5e146e1507 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1506 microversion: 2.1 time: 0.166561 Aug 29 20:30:38.925772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2bfa59d0-e957-44e7-8184-a9b1a1847537 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.170404 Aug 29 20:30:38.926129 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 229/426] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:38 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:38.932436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 198/427] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:38 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:38.974871 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:38.977003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:38.983745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.984413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.984853 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:38.985547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:38.985999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:38.986434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:39.159716 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:39.170338 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:39.171794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:39.172985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f8727eae-b178-4d1a-8e61-b9cdc8a7d180 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1724 microversion: 2.20 time: 0.202101 Aug 29 20:30:39.174976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 230/428] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:38 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:39.350593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "name": "network-vif-unplugged", "status": "completed", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:39.362877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:39.363375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:39.363809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:39.375820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] Creating event network-vif-unplugged:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:30:39.380701 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-6c358bc9-845d-4c03-a753-d26a63bb9afe req-15fe46a2-005a-4d19-b1ff-790293abecec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033840 Aug 29 20:30:39.392665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 199/429] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:39.947093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:39.947713 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:39.955363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:39.955861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:39.957262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:39.957984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:39.958450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:39.958875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:40.116720 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:40.135609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-74cefeb9-fc41-4416-afed-9e4ac55e2633 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.186522 Aug 29 20:30:40.135609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 231/430] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:39 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:40.194056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:40.198258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:40.201474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:40.206174 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:40.206665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:40.207104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:40.207922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:40.208440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:40.208898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:40.342178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:40.353341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:40.354961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:40.356247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8c606aa2-aa6a-4bd9-9780-d8e2e89bebd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1724 microversion: 2.20 time: 0.163211 Aug 29 20:30:40.356897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 200/431] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:40 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:41.152024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:41.152658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:41.165392 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.176594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.176594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:41.176594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.176594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.177221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:41.324799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:41.333722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-81bc9d04-a63a-4cc9-aeaa-3af0db546316 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.186593 Aug 29 20:30:41.334929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 232/432] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:41 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:41.379562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:41.380198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:41.387534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.390968 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.391728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:41.392629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.393319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.400101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:41.556433 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:41.565379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:41.566896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:41.568375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0b189b94-19cd-4834-9f7b-b88813cbc22b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1727 microversion: 2.20 time: 0.193016 Aug 29 20:30:41.569051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 201/433] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:41 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:41.592120 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0236d5c8-d5cc-454d-a426-7169edd0a35f"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:41.594714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:41.600638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.601119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.601586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:41.602805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:41.603252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:41.603662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:42.356943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:42.357471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:42.363477 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:42.372315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:42.372315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:42.372315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:42.372315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:42.372804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:42.503175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:42.511253 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-823b59be-6783-4ebf-b94b-7d533e3fc2a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.158730 Aug 29 20:30:42.511860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 202/434] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:42 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:42.875450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-06c42559-20fe-4cc7-b71f-faa7779bc304 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.280853 Aug 29 20:30:42.875450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 233/435] 10.222.0.85 () {62 vars in 1364 bytes} [Mon Aug 29 20:30:41 2022] POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 188 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:30:42.996304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:42.996904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:43.002876 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.003358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.003796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.004530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.004982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.005406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.050139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121468) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:30:43.408758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e0aafef4-11e7-4605-a2df-d0ad3ec7fb53 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/action" status: 202 len: 0 microversion: 2.20 time: 0.416334 Aug 29 20:30:43.409827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 203/436] 10.222.0.85 () {62 vars in 1319 bytes} [Mon Aug 29 20:30:42 2022] POST /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:30:43.419221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:43.420213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:43.428943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.429442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.429880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.431089 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.431546 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.431980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.531906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:43.532648 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:43.538565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.539042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.539505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.540211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:43.540709 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:43.541128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:43.563670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:43.575246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:43.576257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:43.577779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0a9555aa-e2e0-42a1-b2ff-d25228dd3694 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1753 microversion: 2.20 time: 0.163483 Aug 29 20:30:43.584308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 234/437] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:43 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:43.682481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:43.690510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e0e840bf-acd9-41c2-af85-78f2a32a9116 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.162684 Aug 29 20:30:43.691090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 204/438] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:43 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:44.601336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:44.603310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:44.616937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:44.617436 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:44.618549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:44.619312 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:44.619942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:44.620468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:44.712179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:44.713810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:44.720005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:44.725171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:44.725171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:44.725171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:44.725171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:44.725544 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:44.726886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:44.757007 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:44.772787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:44.774388 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:44.776033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bd156645-1e97-4db5-9f5f-281c56b37b16 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1753 microversion: 2.20 time: 0.178310 Aug 29 20:30:44.776637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 235/439] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:44 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:44.879705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:44.887464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ac93ad3b-6a7a-449d-8969-2ab9cb21ea6d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.179198 Aug 29 20:30:44.888045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 205/440] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:44 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:45.219018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0225746d-0327-418d-a3b2-b83d8c44f479"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:45.221609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:45.228318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.228806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.229239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.229927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.230382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.230809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.248636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:45.578015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:45.578623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:45.585132 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.585613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.586044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.586858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.587310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.587732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.730381 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:45.733976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8659deee-18ee-4c13-b35a-1b272c12e6eb tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1594 microversion: 2.1 time: 0.159628 Aug 29 20:30:45.734460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 206/441] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:45 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:45.800311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:45.800941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:45.807633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.808123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.808596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.816634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:45.816634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:45.816634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:45.983922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:45.992964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:45.994365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:45.995517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3c5ee03e-a741-4cfe-90e2-5383ae14eedb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1755 microversion: 2.20 time: 0.199933 Aug 29 20:30:45.996080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 207/442] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:45 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:46.000465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:46.001068 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:46.015224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:46.015703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:46.016137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:46.016888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:46.017342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:46.017768 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:46.152949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:46.164338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ca202ba1-b6fb-49e0-b1e6-a930f07f683a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.167124 Aug 29 20:30:46.165840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 208/443] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:45 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:46.222245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fd81675c-672d-4cc6-9d50-3cc51d55cd95 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007138 Aug 29 20:30:46.228868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 236/444] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:30:45 2022] POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments => generated 194 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:47.018625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:47.019299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:47.026635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.029045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.029741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.030495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.032217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.032846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.177050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:47.188564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:47.189575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:47.191664 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:47.193308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:47.194633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dc47e88b-a385-45dd-90a7-bb78a9fa51b6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1755 microversion: 2.20 time: 0.179831 Aug 29 20:30:47.195228 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 209/445] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:47 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:47.196891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.197451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.197950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.198701 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.199225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.199653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.685206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:47.685206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5a55c833-233d-497f-991d-ebda310d84e3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.487999 Aug 29 20:30:47.685206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 237/446] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:47 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:48.119933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:48.129377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:48.129848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:48.130328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:48.143419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] Creating event network-changed:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:30:48.149870 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-7cc56667-3593-4977-9dc0-800d3be185a5 req-c1af135e-6368-4f61-a0f6-488c9c8d5322 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033248 Aug 29 20:30:48.150833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 210/447] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:30:48.218623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:48.219284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:48.226899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:48.229107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:48.229107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:48.229107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:48.229107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:48.229457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:48.440803 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:48.444721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:48.446256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:48.447947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7a1cab52-91c9-4289-95d6-fe727faf7b7a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.233389 Aug 29 20:30:48.448963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 238/448] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:48 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:48.694298 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:48.695088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:48.701406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:48.701894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:48.702327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:48.703039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:48.703492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:48.703917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:48.865881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:48.875576 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-580de1fa-85a7-4003-bcae-b41461574305 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.185715 Aug 29 20:30:48.885013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 211/449] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:48 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:49.474953 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:49.476065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:49.478580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=80 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:49.486270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:49.487010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:49.487523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:49.488324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:49.488995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:49.489892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:49.659203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:49.672004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:49.673746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:49.674909 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8410a844-bad9-42d4-8b60-594ba87a5f7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.204431 Aug 29 20:30:49.676580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 239/450] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:49 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:49.902485 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:49.903133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:49.910628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:49.911136 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:49.911586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:49.912373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:49.912842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:49.913272 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:50.150033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:50.158944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3a8a29e9-42bf-44a2-9c05-569ca9011e8f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.260376 Aug 29 20:30:50.159628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 212/451] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:49 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:50.699169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:50.699776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:50.706531 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:50.707021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:50.707462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:50.708184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:50.708646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:50.709071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:50.856144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:50.866020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:50.867566 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:50.869533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3f185761-131c-4f5a-9b81-502504dd98c4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.174617 Aug 29 20:30:50.870438 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 240/452] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:50 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:50.948762 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2136121277"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:50.949379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:50.961796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:50.962592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:50.963025 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:50.963738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:50.964390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:50.964963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.181711 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:51.182559 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:51.191655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.network.security_group_api [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Adding security group b3f5eb80-9642-4864-9187-ecaa99c24bd7 to port 5c074101-5a5e-40f6-b6e6-70b660e8c958 Aug 29 20:30:51.195343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.195918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.196392 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.197122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.197625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.198070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.398213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:51.417131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b5dbb7e3-1590-42dd-803a-baf4fc18e833 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.230861 Aug 29 20:30:51.417131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 241/453] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:51 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:51.758706 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8145adc2-a952-4854-a8a8-8ab34b9c5f63 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.814141 Aug 29 20:30:51.759942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 213/454] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:30:50 2022] POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:30:51.781272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:30:51.792047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:51.793625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:51.804913 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.805696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.806310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.806860 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.807249 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.807700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.813978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.815714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.816439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.824328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] Creating event network-changed:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:30:51.833508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6b0105d6-7aa2-43d5-a1fb-412a95c07bad req-b470047f-e898-406a-9faf-2806d23389b2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070579 Aug 29 20:30:51.840316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 242/455] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:30:51.909080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:51.910156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:51.922208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.922700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.923131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:51.923825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:51.924300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:51.924767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:52.031590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:52.048927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6ffe3e1e-53d0-43a9-a542-a3fbaa150fba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1759 microversion: 2.1 time: 0.263561 Aug 29 20:30:52.048927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 214/456] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:51 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1759 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:52.101459 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:52.111128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:52.113192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:52.114915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1c054171-b09e-4f3d-8ec2-50e2f1fc8714 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.224555 Aug 29 20:30:52.116319 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 243/457] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:51 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:30:52.438261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:52.439190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:52.446889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:52.447726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:52.448226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:52.449126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:52.449575 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:52.450003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:52.630373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:52.638968 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-be09f6f4-c583-4dd4-b1ea-5de53a6fa146 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.205044 Aug 29 20:30:52.639545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 215/458] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:52 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:53.142966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:53.144241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:53.153821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:53.154316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:53.154757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:53.155587 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:53.156050 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:53.156584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:53.309279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:53.315758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:53.317255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:53.318495 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e6678e46-2cbd-4195-b72d-fbcfb2fd80e7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.179734 Aug 29 20:30:53.319073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 244/459] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:53 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:53.660629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:53.661401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:53.668410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:53.669206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:53.669873 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:53.670785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:53.671438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:53.672086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:53.827406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:53.840465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fea054e7-7fec-472b-8486-3c60c238af26 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.183610 Aug 29 20:30:53.841680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 216/460] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:53 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:54.342703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:54.344091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:54.352703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:54.353605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:54.354262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:54.355094 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:54.355710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:54.356229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:54.497727 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:54.506868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:54.509073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:54.510314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f0717787-7ae7-444b-9d8f-0251f57ad1b8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.172383 Aug 29 20:30:54.511030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 245/461] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:54 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:54.877001 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:54.878564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:54.885763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:54.888583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:54.888583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:54.888583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:54.889378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:54.890023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:55.052319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:55.060618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4343a5de-cd35-4c7c-aeb7-b25eaad6155b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.194979 Aug 29 20:30:55.061177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 217/462] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:54 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:55.535221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:55.535878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:55.542337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:55.542812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:55.543479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:55.544214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:55.544663 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:55.545089 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:55.695641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:55.704637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:55.706092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:55.707265 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e5bdbcfa-cd44-48c1-964f-1879a502e587 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.176878 Aug 29 20:30:55.707825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 246/463] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:55 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:56.081723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:56.082425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:56.088456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:56.088942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:56.089370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:56.090577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:56.091022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:56.091437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:56.236183 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:56.244027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bba66b96-ceaa-4caf-9bde-efd104da2323 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.166157 Aug 29 20:30:56.244627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 218/464] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:56 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:56.730790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:56.732206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:56.739548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:56.740432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:56.741129 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:56.742055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:56.742724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:56.743365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:56.881080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:56.890173 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:56.891920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:56.893325 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c609c8b3-8b0e-4c3a-a44d-0f8e3d5e7dfb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.166827 Aug 29 20:30:56.908071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 247/465] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:56 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:57.264812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:57.265419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:57.271641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:57.272124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:57.272589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:57.273274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:57.274235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:57.274661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:57.411085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:57.420085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8272c2b7-883f-4228-865d-2a60fb2c91a1 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.159048 Aug 29 20:30:57.421011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 219/466] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:57 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:30:57.916845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:57.917730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:57.924635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:57.925145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:57.925568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:57.926272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:57.926725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:57.927154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:58.062107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:58.070343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:58.072477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:58.073644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d9e34c0b-f05c-4904-b38b-deb6d432a10f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.161793 Aug 29 20:30:58.074257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 248/467] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:57 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:58.443173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:58.443911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:58.451930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:58.452652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:58.453270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:58.454289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:58.455024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:58.455503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:58.607594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:58.616497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9fa37ac8-4fe8-44f5-98ec-fe1263b259be tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.177158 Aug 29 20:30:58.617641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 220/468] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:58 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:59.096705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:59.136029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:59.136029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.136029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.136029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.137519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.137519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.137519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.308395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:59.317194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:59.318613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:59.319778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d4223d47-39cb-4cb0-86b9-5f3aa00bc5bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.227049 Aug 29 20:30:59.332390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 249/469] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:30:59 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:59.637916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:59.638798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:30:59.645171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.652065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.652065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.652065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.652065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.652582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.786023 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:30:59.795312 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6103296d-6caf-4dd3-9984-de11f2c98e64 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.161501 Aug 29 20:30:59.799355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 221/470] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:30:59 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:00.241245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dc6595c-606b-4035-8425-26b88a000647", "device": "/dev/sdb"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:00.244628 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:00.251841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.252827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.253432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.254319 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.254779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.255213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.344001 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:00.344887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:00.350983 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.351560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.352600 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.353361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.353941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.354429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.498072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:00.501829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:00.507757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:00.509269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:00.510424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-10164835-d36f-4cb0-8eaa-35ae8a5718f3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.171044 Aug 29 20:31:00.510987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 222/471] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:00 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:00.819190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:00.819850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:00.826488 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.826968 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.827400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.828084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:00.828569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:00.828996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:00.961137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:00.969224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f743f86f-b3a3-46be-8dc2-a696f92d7f7e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.154206 Aug 29 20:31:00.970017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 223/472] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:00 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:01.533593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:01.534139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:01.536121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:01.541646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:01.542107 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:01.542547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:01.543268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:01.543726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:01.544160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:01.678454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:01.686955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:01.688442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:01.689728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-abd43608-9b6d-43d0-a5cb-5a729b19fde3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.160071 Aug 29 20:31:01.690286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 224/473] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:01 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:01.990290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:01.990958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:01.997683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:01.998169 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:01.998603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:01.999287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:01.999738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:02.000160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:02.123872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:02.131696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-05664c65-6e27-458a-9381-28abf9032e42 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1676 microversion: 2.1 time: 0.145199 Aug 29 20:31:02.132324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 225/474] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:01 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:02.712745 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:02.713352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:02.719313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:02.719796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:02.720263 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:02.720961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:02.721409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:02.721828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:02.852613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:02.861718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:02.863402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:02.864596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5f067d66-1391-4a7d-b7a7-e5708050099d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.156412 Aug 29 20:31:02.865149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 226/475] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:02 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:03.153487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:03.154230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:03.160069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.160580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.161013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.161688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.162137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.162896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.293022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:03.300668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-280809ec-33e9-4d01-8a95-090e96bd109d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1653 microversion: 2.1 time: 0.150989 Aug 29 20:31:03.301230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 227/476] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:03 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1653 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:03.320045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:03.326196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.326672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.327099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.349048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Going to try to start instance {{(pid=121468) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:31:03.662080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-038e1156-67e1-4cfc-80ac-e328c17b639d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action" status: 202 len: 0 microversion: 2.1 time: 0.345293 Aug 29 20:31:03.662984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 228/477] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:31:03 2022] POST /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:31:03.672460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:03.673085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:03.679583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.680626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.681058 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.681752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.682204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.682643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.858400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:03.866282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fb8b70b4-304d-4096-9303-8fb99165737f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1662 microversion: 2.1 time: 0.198837 Aug 29 20:31:03.866842 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 229/478] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:03 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:03.887208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:03.887843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:03.893660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.894137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.894565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:03.895284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:03.896000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:03.896448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:04.023038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:04.031771 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:04.033244 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:04.034479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9614e342-aa68-428e-81d6-ce813b9e86f8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.151680 Aug 29 20:31:04.035028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 230/479] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:03 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:04.321145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f2927f8c-8e15-4de4-8266-7da0037d7208 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "POST /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.082802 Aug 29 20:31:04.321788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 250/480] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:31:00 2022] POST /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca/os-volume_attachments => generated 194 bytes in 4085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:31:04.886959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:04.887572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:04.894221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:04.894714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:04.895208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:04.896138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:04.896621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:04.897044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:05.049114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:05.056993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-89b20e2e-b676-4a6b-9cc9-6f67fc9540d5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1662 microversion: 2.1 time: 0.173988 Aug 29 20:31:05.057558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 231/481] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:04 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:05.067722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:05.068530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:05.076007 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:05.076519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:05.076952 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:05.077660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:05.078261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:05.078679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:05.082678 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:05.210274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:05.219786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:05.221331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:05.222494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e6c0d345-11ca-4659-8637-308ceab706f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.159511 Aug 29 20:31:05.223066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 251/482] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:05 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:05.622820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:05.625133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:05.636352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:05.636352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:05.636352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:05.636352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:05.636731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:05.636731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:05.657841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'flavor' on Instance uuid 01fc9fa6-a539-48d8-9953-d193eaf317d8 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:31:06.055629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-36f58ea7-dbd3-40be-b1ce-80789f9b16af tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/action" status: 200 len: 32 microversion: 2.1 time: 0.436698 Aug 29 20:31:06.057035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 232/483] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:31:05 2022] POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/action => generated 32 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:31:06.065447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:06.066099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:06.073056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.073548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.073997 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.074693 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.075195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.075624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.077566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:06.078272 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:06.084402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.084916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.085353 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.086550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.087003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.087427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.212409 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:06.220813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dc4d9849-3837-4b6f-a78d-0f8103d2cd27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.159286 Aug 29 20:31:06.221392 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 252/484] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:06 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:06.225652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:06.233907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c34ed66a-0c19-48c6-bcf6-70498587e478 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1666 microversion: 2.1 time: 0.160705 Aug 29 20:31:06.234476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 233/485] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:06 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:06.244965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:06.245647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:06.251630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.252127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.252600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.253291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:06.253748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:06.254172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:06.386087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:06.394658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:06.396394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:06.397633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-cc047f86-5e4a-42ad-9fdb-32047b67e956 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.156581 Aug 29 20:31:06.398185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 253/486] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:06 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:07.242958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:07.243509 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:07.250260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:07.250745 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:07.251184 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:07.251867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:07.252358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:07.252782 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:07.379069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:07.388039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0872bed8-132b-4268-b7a2-0f7765688e27 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.149078 Aug 29 20:31:07.388668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 234/487] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:07 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:07.420314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:07.420923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:07.427692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:07.428193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:07.428647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:07.429333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:07.430291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:07.430717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:07.561879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:07.571188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:07.572724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:07.573885 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3d7c660a-52ec-4b0c-a002-f44e805c2e18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.157460 Aug 29 20:31:07.574534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 254/488] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:07 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:08.409529 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:08.410168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:08.416911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:08.417398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:08.417835 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:08.418522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:08.418978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:08.419405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:08.548065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:08.556961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6aa66a8e-1b2b-4021-a237-498982ac83a3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.151289 Aug 29 20:31:08.557580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 235/489] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:08 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:08.596153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:08.596774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:08.603730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:08.604321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:08.604782 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:08.605459 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:08.605906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:08.606355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:08.734603 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:08.743709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:08.745166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:08.746302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dde66002-16b5-493a-9cd0-f13895b977a1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.153995 Aug 29 20:31:08.746862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 255/490] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:08 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:09.579237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:09.579847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:09.585828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:09.587124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:09.587361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:09.588048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:09.588569 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:09.588997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:09.609501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.721379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:09.730062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b3c17bc9-bfc9-40a3-bc47-00b7024f6230 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.154760 Aug 29 20:31:09.730633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 236/491] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:09 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:09.768530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:09.769215 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:09.776418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:09.776897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:09.777329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:09.778031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:09.778464 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:09.778887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:09.907677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:09.916987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:09.918440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:09.919591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f5de6ca3-e23d-4501-8da7-7684f3452be1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.154943 Aug 29 20:31:09.920150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 256/492] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:09 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:10.751067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:10.751679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:10.758506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:10.758992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:10.759428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:10.760115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:10.760592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:10.761017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:10.889503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:10.898058 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-114727cd-1127-4bb3-b767-d175a950503c tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.150734 Aug 29 20:31:10.898630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 237/493] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:10 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:10.942565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:10.943167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:10.950299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:10.950781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:10.951214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:10.951899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:10.952387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:10.952810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:11.086764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:11.095366 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:11.096833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:11.098010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3f73008b-e749-45dc-af1d-78893d42200c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.159281 Aug 29 20:31:11.098569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 257/494] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:10 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:11.919928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:11.920534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:11.926527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:11.927005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:11.927440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:11.928216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:11.928709 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:11.929239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:12.053905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:12.062168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-97debc9f-9d30-4b07-8c76-4ac3aa47de41 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.146123 Aug 29 20:31:12.062752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 238/495] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:11 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:12.120462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:12.121056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:12.127329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:12.127798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:12.128272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:12.128945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:12.129476 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:12.129890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:12.279640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:12.289475 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:12.291160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:12.292384 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2fcbb2df-6461-4f10-b903-8415b686831a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.175888 Aug 29 20:31:12.298974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 258/496] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:12 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:13.084275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:13.085000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:13.091591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:13.096355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:13.096355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:13.096355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:13.096355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:13.096738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:13.315373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:13.315985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:13.322631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:13.323120 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:13.323559 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:13.324298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:13.324816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:13.325245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:13.460290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:13.469808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:13.471260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:13.472847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e152284d-f53c-4e7e-8c1f-67e2348c5969 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.161528 Aug 29 20:31:13.473412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 259/497] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:13 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:13.473980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:13.482484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3349cec2-a7fe-48fe-b4b2-7b4537cdc572 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.402119 Aug 29 20:31:13.483135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 239/498] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:13 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:13.789219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "name": "network-vif-plugged", "status": "completed", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:13.798756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:13.799921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:13.799921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:13.811268 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] Creating event network-vif-plugged:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:31:13.816076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-9dccd284-da23-4cbe-b0e3-79c602635b49 req-afb05b50-ca20-4c33-9b3c-d7524973da11 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030589 Aug 29 20:31:13.816696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 260/499] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:31:14.496113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:14.496888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:14.503373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:14.504080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:14.504546 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:14.505245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:14.505704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:14.506130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:14.506862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:14.507694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:14.514795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:14.515431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:14.515938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:14.516730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:14.517298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:14.517785 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:14.646101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:14.655051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:14.656523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:14.657690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f1080d56-4356-4b8c-b1cf-1bd69f23a244 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.165483 Aug 29 20:31:14.660668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:14.663214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 240/500] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:14 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:14.669462 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-78c1c637-c7e3-4ff8-8021-bbdd75dfaaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.168941 Aug 29 20:31:14.670018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 261/501] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:14 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:15.687616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:15.688246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:15.690888 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:15.691502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:15.695363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:15.695846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:15.696308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:15.697008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:15.697457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:15.697880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:15.698224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:15.698723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:15.699162 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:15.700026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:15.700505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:15.700929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:15.831345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:15.831498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:15.839981 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e912c82f-ded0-4bce-a2a3-4950a7e68241 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.153123 Aug 29 20:31:15.840550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:15.840707 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 262/502] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:15 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:15.842066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:15.843331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f5f67d5c-25e9-41a4-8a30-2561e5131d63 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.160409 Aug 29 20:31:15.843896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 241/503] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:15 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:31:16.862092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:16.862740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:16.866765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:16.867455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:16.869564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:16.870056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:16.870500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:16.871190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:16.871648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:16.872074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:16.873342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:16.873861 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:16.874266 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:16.874956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:16.875411 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:16.875837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:17.006755 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:17.013639 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:17.015786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7651eee2-54ca-41fa-ade2-a3d2a4c919fe tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.157518 Aug 29 20:31:17.016591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 263/504] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:16 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:17.023107 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:17.025153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:17.027044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-801732e3-0f37-4a10-bd70-19aeb4741fd6 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.164181 Aug 29 20:31:17.027608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 242/505] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:16 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:18.038385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:18.039635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:18.046246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:18.046729 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:18.047161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:18.047850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:18.048339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:18.048813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:18.050580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:18.051200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:18.057086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:18.057565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:18.058004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:18.058695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:18.059149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:18.059574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:18.179153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:18.187912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-48175e45-5a82-41bc-8d97-9ca30cf01502 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.153444 Aug 29 20:31:18.191908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:18.200259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 264/506] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:18 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:18.202525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:18.204048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:18.205289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-792de73d-8eef-4e6e-bb16-3d3af157e26f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.158577 Aug 29 20:31:18.205997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 243/507] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:18 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:19.209531 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:19.210151 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:19.217263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:19.217745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:19.218182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:19.218862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:19.219313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:19.219736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:19.227360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:19.227973 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:19.234147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:19.238254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:19.238254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:19.238254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:19.238254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:19.238639 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:19.355637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:19.364474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b9a672bb-8c52-4447-9e9e-aa92eacba411 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.158723 Aug 29 20:31:19.365047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 265/508] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:19 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:19.367804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:19.376422 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:19.377865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:19.379018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8a3426af-f1d1-4afe-923e-9859ed550998 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.155668 Aug 29 20:31:19.379606 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 244/509] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:19 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:20.387463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:20.388010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:20.390413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=54 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.395093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:20.395576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:20.396309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:20.397004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:20.397460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:20.397892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:20.403041 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:20.403041 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:20.408106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:20.408628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:20.409072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:20.409762 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:20.410219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:20.410677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:20.529629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:20.538001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d9c97c12-3531-4144-b681-b6b0a3f82929 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.155084 Aug 29 20:31:20.539365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 266/510] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:20 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:20.548103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:20.556772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:20.558235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:20.559385 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e3afa186-0c5b-40b7-bf96-ccb68f03e669 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.161614 Aug 29 20:31:20.559941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 245/511] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:20 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:21.560095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:21.560726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:21.567154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:21.567630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:21.568079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:21.568794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:21.569307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:21.569726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:21.581972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:21.582575 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:21.588436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:21.588915 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:21.589344 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:21.590036 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:21.590464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:21.590877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:21.704766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:21.713231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-965fa4cb-e09d-4b8d-b09a-f83df9fa9fb5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.157075 Aug 29 20:31:21.713822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 267/512] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:21 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:21.719733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:21.728849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:21.730287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:21.731435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3a1c73ac-ca1d-4736-8387-5c317ef892d3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.153377 Aug 29 20:31:21.731985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 246/513] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:21 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:22.734823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:22.735441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:22.742527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:22.743054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:22.743490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:22.744198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:22.750044 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:22.750044 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:22.754151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:22.754751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:22.760838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:22.762727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:22.763241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:22.763670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:22.764463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:22.764912 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:22.765327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:22.877678 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:22.886605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ae4df24b-7a5c-47be-8572-2a0c01fe5b7b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.155612 Aug 29 20:31:22.887212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 268/514] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:22 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:22.899274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:22.907755 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:22.909198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:22.910334 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0ea4351a-09e7-41ee-bc1d-f606086e5025 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.160123 Aug 29 20:31:22.910936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 247/515] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:22 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:23.907263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:23.907902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:23.914394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:23.914880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:23.915318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:23.916000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:23.916484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:23.916910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:23.933847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:23.934458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:23.941562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:23.946035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:23.946035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:23.946035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:23.946035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:23.946502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:24.051248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:24.060048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-23c4f298-4957-4bc8-aa89-3e443d8d0906 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.156589 Aug 29 20:31:24.060985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 269/516] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:23 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:24.082747 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:24.091509 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:24.093108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:24.094260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4f74798c-2be9-4142-b433-2eb10f745b1f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.164325 Aug 29 20:31:24.094852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 248/517] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:23 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:25.081665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:25.082208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:25.088573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:25.089054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:25.089527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:25.090206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:25.090657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:25.091080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:25.117696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:25.118291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:25.124294 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:25.124783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:25.125214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:25.125902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:25.126353 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:25.126772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:25.231806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:25.240110 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1ad82c1d-aa92-44db-a0fa-fe7551b533bf tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.162349 Aug 29 20:31:25.240710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 270/518] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:25 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:25.263742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:25.272652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:25.274872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:25.276047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ed5497f9-86ac-4ad8-b61e-f66f15517e50 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1811 microversion: 2.20 time: 0.163126 Aug 29 20:31:25.277516 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 249/519] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:25 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:26.262282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:26.262882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:26.269259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:26.269736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:26.270166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:26.271138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:26.271585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:26.272074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:26.298173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:26.298779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:26.305232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:26.305720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:26.306157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:26.306851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:26.307306 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:26.307738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:26.403929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:26.412294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-db40aaef-1958-41ae-8134-d5da802eef94 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.154552 Aug 29 20:31:26.413057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 271/520] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:26 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:26.438557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:26.447402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:26.448934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:26.450138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dea4c24b-4f5e-4a7a-8221-88a95ec9ca5f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1798 microversion: 2.20 time: 0.155837 Aug 29 20:31:26.450693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 250/521] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:31:26 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1798 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:31:27.434974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:27.435584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:27.442008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:27.442493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:27.442927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:27.443652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:27.444105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:27.444556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:27.575463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:27.584095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-236a21e2-9c13-4d4f-9bf9-731e4f5ba44d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.153040 Aug 29 20:31:27.584694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 272/522] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:27 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:28.606382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:28.607116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:28.613281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:28.613775 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:28.614212 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:28.614908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:28.615364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:28.615964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:28.748435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:28.756705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-48687882-c577-4bbc-99e1-500959c8120f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.154202 Aug 29 20:31:28.757282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 251/523] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:28 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:29.778737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:29.779349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:29.785921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:29.786405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:29.786841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:29.787534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:29.787989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:29.788482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:29.921235 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:29.929651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8a885af9-e4da-4c5a-afda-6b28369d3d7a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.154663 Aug 29 20:31:29.930219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 273/524] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:29 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:30.949862 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:30.950372 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:30.956430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:30.956917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:30.957356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:30.958050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:30.958504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:30.958945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:31.092484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:31.101070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b2691265-0aa1-43dc-917c-a93acf16dd13 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.155030 Aug 29 20:31:31.102174 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 252/525] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:30 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:32.122589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:32.123225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:32.129682 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:32.130159 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:32.130587 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:32.131264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:32.131710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:32.132631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:32.261505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:32.270136 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ec596074-a7b7-465e-b90c-ca8b38e1b3f1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.151244 Aug 29 20:31:32.270696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 274/526] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:32 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:33.291206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:33.291816 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:33.296838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=58 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:33.298619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:33.299100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:33.299538 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:33.300258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:33.300715 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:33.301140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:33.302410 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:33.302909 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:33.305232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=100 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:33.311064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:33.311064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:33.311064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:33.311064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:33.311447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:33.311604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:33.445104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:33.445775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lazy-loading 'services' on Instance uuid 5508dfc8-8be5-4b99-aa5d-0d4764f832ca {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:31:33.446321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2e7d725c-a06c-42a1-a129-7733e86e3a1e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.159471 Aug 29 20:31:33.446972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 253/527] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:33 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:33.857499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1a7d0cf9-1486-4d18-bb88-424a04aee8fc tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca/os-volume_attachments/8dc6595c-606b-4035-8425-26b88a000647" status: 202 len: 0 microversion: 2.1 time: 0.558698 Aug 29 20:31:33.858032 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 275/528] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:31:33 2022] DELETE /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca/os-volume_attachments/8dc6595c-606b-4035-8425-26b88a000647 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:31:34.468209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:34.468819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:34.474844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:34.475323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:34.475781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:34.477091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:34.477550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:34.477977 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:34.608133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:34.617198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-83ecf89e-cc78-45b8-8541-e3f65cdffaf8 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.152207 Aug 29 20:31:34.617772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 254/529] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:34 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:35.639267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:35.639968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:35.646446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:35.646932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:35.647367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:35.648573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:35.649031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:35.649454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:35.779496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:35.787768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5e5ebeda-aa98-46d2-a62a-18cff917f827 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.153267 Aug 29 20:31:35.789038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 276/530] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:35 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:36.809831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:36.810444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:36.816746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:36.817230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:36.817665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:36.818352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:36.818803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:36.819225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:36.949062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:36.957285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fe32a6a3-1746-41b3-9fd3-4119b9239b1f tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.151312 Aug 29 20:31:36.957878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 255/531] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:36 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:37.979458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:37.980210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:37.986732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:37.987219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:37.987657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:37.988404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:37.988857 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:37.989283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:38.122313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:38.130695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4d544bea-649e-46fc-b8cc-29d4715fd9a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1732 microversion: 2.1 time: 0.155592 Aug 29 20:31:38.131388 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 277/532] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:37 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:38.150765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:38.151276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:38.157343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:38.157823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:38.158279 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:38.158965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:38.159412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:38.159838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:38.186158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:31:38.537262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4b7f3257-a8ab-4fc8-a1a8-623917a21c25 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 204 len: 0 microversion: 2.1 time: 0.390160 Aug 29 20:31:38.537837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 256/533] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:31:38 2022] DELETE /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:31:38.546498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:38.547106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:38.553607 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:38.554708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:38.555141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:38.555815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:38.556297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:38.556718 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:38.691863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:38.700711 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dc66d9e3-709a-4e8a-8ba0-316bde54ed6a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1512 microversion: 2.1 time: 0.157870 Aug 29 20:31:38.701281 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 278/534] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:38 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:39.152922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:39.153620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:39.159527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.160009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.160476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.161160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.161611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.162033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.292811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:39.300876 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-30fd1a80-9f77-4798-b425-37e03f2d8f9d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1712 microversion: 2.1 time: 0.152158 Aug 29 20:31:39.301448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 257/535] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:39 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:39.411970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:39.412541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:39.419460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.419942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.420427 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.421113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.443527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.443527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.504970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] HTTP exception thrown: Cannot 'detach_volume' instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 while it is in vm_state rescued Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Request method failure captured: Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments/0225746d-0327-418d-a3b2-b83d8c44f479 HTTP/1.1 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEdbr0UBGbc1Dkaicuy7soLHnPMv1dFKhKkjv81PWp3YW63sX1CUZXNW9OLOr9Eyg9B9cw0aWHIPuvvwgwdcnR9ZuLbR3nPeFnw_xLx5hYb8NDNwdcbazd1ADSsE11RR6IaYtXMWJ8eX4_p2qgfPRSHVug8lNZHOXLJTqaFF-H52ig Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:31:39.506554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_66be3e70cbf742269fe9306a7b7e8fe0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 336345e5437341ba9859d776c44ea4be Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:31:39.508045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Cannot 'detach_volume' instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 while it is in vm_state rescued Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'server_id': '01fc9fa6-a539-48d8-9953-d193eaf317d8', 'id': '0225746d-0327-418d-a3b2-b83d8c44f479'} Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:31:39.508992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 while it is in vm_state rescued Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 while it is in vm_state rescued Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:31:39.510625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Returning 409 to user: Cannot 'detach_volume' instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 while it is in vm_state rescued {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:31:39.511931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f3643da-10eb-4edb-b090-16f48d42fb34 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments/0225746d-0327-418d-a3b2-b83d8c44f479" status: 409 len: 152 microversion: 2.1 time: 0.100078 Aug 29 20:31:39.511931 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 279/536] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:31:39 2022] DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments/0225746d-0327-418d-a3b2-b83d8c44f479 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:31:39.516892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:39.517436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:39.524128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.524634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.525072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.525782 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.526235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.526660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.722061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:39.722593 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:39.729327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.729810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.730244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.730941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.731379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.731804 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.847371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-84e5b3b5-c20a-4660-8171-408a85a5e644 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/action" status: 202 len: 0 microversion: 2.1 time: 0.334016 Aug 29 20:31:39.851460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 258/537] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:31:39 2022] POST /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:31:39.856817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:39.857510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:39.863735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.864377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.864831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.865531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:39.865985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:39.866985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:39.867275 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:39.875190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-16e0c39c-63b8-405d-929f-271898cc6da0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1512 microversion: 2.1 time: 0.157435 Aug 29 20:31:39.875749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 280/538] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:39 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:39.999149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:40.007401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-892e8cc2-ca75-47d5-9e82-b7c02f5e6a77 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1720 microversion: 2.1 time: 0.154549 Aug 29 20:31:40.007967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 259/539] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:39 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:40.419816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:40.422078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:40.428423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.429414 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.429844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:40.430520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.430963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.431379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:40.758303 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-163c228a-bdb5-4ef7-a57d-779cfce54c68 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.342819 Aug 29 20:31:40.758936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 281/540] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:31:40 2022] POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:31:40.767087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:40.767727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:40.774048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.776204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.776204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:40.776204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.776204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.776688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:40.899732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:40.900478 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:40.906711 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.907199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.907633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:40.908348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:40.908800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:40.909220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:41.045296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:41.047205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:41.055248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f835e747-442a-4053-8630-3078364b0281 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1751 microversion: 2.1 time: 0.291980 Aug 29 20:31:41.055639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-90071184-80c8-485b-869d-002eb5a3e3b8 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1512 microversion: 2.1 time: 0.160897 Aug 29 20:31:41.068136 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 260/541] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:40 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1751 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:41.068136 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:41.068136 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:41.070523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 282/542] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:40 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:41.070897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:41.071833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:41.071959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:41.072759 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:41.073321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:41.073835 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:41.488993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:41.497290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e4d98985-8ff7-4b8f-8c31-fa5fb4b01f0b tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1720 microversion: 2.1 time: 0.439886 Aug 29 20:31:41.497863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 261/543] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:41 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1720 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:42.079209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:42.079796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:42.080210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:42.080330 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:42.085750 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.086238 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.086677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.087376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.087498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.088077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.088232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.088538 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.089085 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.089754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.090270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.109317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:42.235754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:42.236818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:42.245391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-afe5fced-34d5-4c13-85ab-188939f35569 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1512 microversion: 2.1 time: 0.170240 Aug 29 20:31:42.246168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 262/544] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:42 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:42.259029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-db098e67-65c9-4166-937b-ed7667eb2e04 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1751 microversion: 2.1 time: 0.172934 Aug 29 20:31:42.259900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 283/545] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:42 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:42.349343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5508dfc8-8be5-4b99-aa5d-0d4764f832ca", "name": "network-vif-deleted", "tag": "aa326d67-2531-4f2a-9033-868d0d1708f2"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:42.359454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.359930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.360403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.371918 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] Creating event network-vif-deleted:aa326d67-2531-4f2a-9033-868d0d1708f2 for instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca on hv-cinder-85200 Aug 29 20:31:42.377017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-d9d8f823-657d-41ce-a777-f2ff2d00eec7 req-de1da07e-d801-4d8c-81cf-17143cd2270c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Aug 29 20:31:42.377611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 263/546] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:31:42.519370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:42.519918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:42.527467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.527940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.528402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.529118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:42.529658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:42.530096 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:42.661174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:42.669670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5aaee123-f27c-41a0-940b-1f098de64363 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1720 microversion: 2.1 time: 0.154599 Aug 29 20:31:42.673283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 284/547] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:42 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:43.266365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:43.267063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:43.273997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.274478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.274913 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:43.275593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.276044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.276496 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:43.279410 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:43.280020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:43.287102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.287587 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.288062 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:43.289383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.289835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.290256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:43.340413 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:43.348187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-05ba2f32-e87c-4fd3-a53c-e39e65f75525 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1470 microversion: 2.1 time: 0.086006 Aug 29 20:31:43.348778 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 264/548] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:43 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1470 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:43.435298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:43.443581 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7452cd3c-da03-40c6-9ec8-98e10444b627 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.168032 Aug 29 20:31:43.444193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 285/549] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:43 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:43.690851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:43.691455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:43.698111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.698593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.699028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:43.699711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:43.700186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:43.700611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:44.074091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:44.082384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a0fc1a80-c52e-4811-91b5-6c9b9c05b464 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1720 microversion: 2.1 time: 0.395465 Aug 29 20:31:44.082968 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 265/550] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:43 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1720 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:44.370395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:44.370933 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:44.377559 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:44.378534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:44.378534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:44.380984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:44.380984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:44.380984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:44.447662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:44.455447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e0d23ec3-ccd8-42f7-898b-165534c1d116 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1302 microversion: 2.1 time: 0.089662 Aug 29 20:31:44.456080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 286/551] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:44 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:44.466063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:44.467412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:44.473625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:44.474123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:44.474561 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:44.475261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:44.475724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:44.476144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:44.619050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:44.630186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0c1c8a23-3ac4-4ba4-adf1-d8bcaeec25c8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.165038 Aug 29 20:31:44.630186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 266/552] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:44 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:45.103926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:45.104567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:45.110551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.111031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.111463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.112146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.112617 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.113037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.242797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:45.251157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-04cee865-2293-40ae-886d-0ede0e6bda31 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1726 microversion: 2.1 time: 0.151726 Aug 29 20:31:45.251715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 287/553] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:45 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:45.272223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:45.273322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:45.279471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.279988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.280448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.281149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.281602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.282055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.367084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8350203e-b69f-4bf0-b438-bfe8220020aa tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094279 Aug 29 20:31:45.367084 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 267/554] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:31:45 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:31:45.476811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:45.477415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:45.483710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.484219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.484654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.485334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.485779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.486197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.518908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.519406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.519837 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.520299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lazy-loading 'fault' on Instance uuid 5508dfc8-8be5-4b99-aa5d-0d4764f832ca {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:31:45.569412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:45.577310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0ec94877-c8af-46c3-ad4a-bd981f9549fd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 200 len: 1307 microversion: 2.1 time: 0.104993 Aug 29 20:31:45.577892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 288/555] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:45 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:45.649164 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:45.649782 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:45.655764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.656283 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.657013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.657706 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:45.658161 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:45.658583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:45.662735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:45.922828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:45.931229 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f9fdcbfe-8f74-4440-92e8-46f6e479543e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.286853 Aug 29 20:31:45.931908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 268/556] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:45 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:46.451753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:46.461426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:46.461985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:46.462476 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:46.473605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] Creating event network-changed:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:31:46.480271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-e34ba56d-4ad7-4683-8aa5-43d28c4b8936 req-3a31004a-15a1-4913-84fe-a89dba7cc4c9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Aug 29 20:31:46.481217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 289/557] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:31:46.601751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:46.602661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: 5508dfc8-8be5-4b99-aa5d-0d4764f832ca] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:46.609827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:46.610595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:46.611257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:46.612052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:46.612595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:46.613080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:46.629843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] HTTP exception thrown: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Request method failure captured: Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca HTTP/1.1 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSHUnnn_aDP186v-hXff-gap0BCTd3ZZkYA04Q8_sInkuSrO2Ogpa0sD2hXI2vW2ac1pwfOYU--2rj5me-ClRulIqNh5gAGoFYom3Toc1gVa8OflVWTJuAuYV-rMW9oArNNRnRiXnZyUYA7-xBkVSnQyw4tr0KYLGt1nIza-AmGhkvM Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: ac65a0d70d7045d183a8a725b304c169 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:31:46.631521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ac65a0d70d7045d183a8a725b304c169", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: ac65a0d70d7045d183a8a725b304c169 Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesSnapshotTestJSON-1011589115-project Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 83efc8c932d04432ad3d0c974e0333a9 Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesSnapshotTestJSON-1011589115-project Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. Aug 29 20:31:46.637379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '5508dfc8-8be5-4b99-aa5d-0d4764f832ca'} Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:31:46.638347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. Aug 29 20:31:46.639930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:31:46.641416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Returning 404 to user: Instance 5508dfc8-8be5-4b99-aa5d-0d4764f832ca could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:31:46.641416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8911cd9a-7af3-411d-baa3-eac84c9f35a4 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca" status: 404 len: 111 microversion: 2.1 time: 0.035770 Aug 29 20:31:46.641416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 269/558] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:46 2022] GET /compute/v2.1/servers/5508dfc8-8be5-4b99-aa5d-0d4764f832ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:31:46.953784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:46.954738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:46.962450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:46.963171 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:46.968310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:46.968310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:46.968310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:46.968310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:47.134200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:47.143287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e43d0fe0-b165-4c43-92e4-8b9aa288a2be tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.193872 Aug 29 20:31:47.144016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 290/559] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:46 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:48.165126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:48.165871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:48.172186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:48.172679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:48.173114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:48.173839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:48.174292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:48.174723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:48.316024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:48.324114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c03504b3-5f69-4b9c-88f5-8dc62022934e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.163541 Aug 29 20:31:48.324714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 270/560] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:48 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:48.495488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:48.505458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:48.506003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:48.507284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:48.518140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] Creating event network-changed:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:31:48.523419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-c3915a4a-4341-4aef-af89-9d4e9bec1336 req-33bc0ab4-3fcd-4e88-bfe5-913d32b5c754 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032212 Aug 29 20:31:48.524402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 291/561] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:31:49.345515 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:49.346127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:49.352780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:49.353276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:49.353691 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:49.354383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:49.354844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:49.355267 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:49.494577 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:49.502878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-adc0f618-7902-4336-a083-c30605c9e852 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.161227 Aug 29 20:31:49.503448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 271/562] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:49 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:50.525571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:50.531710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:50.531710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=54 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:50.533603 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:50.534086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:50.534520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:50.535205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:50.535653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:50.536074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:50.685550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:50.693833 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a028ca24-c290-43d8-9874-3f6c26da3601 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.173310 Aug 29 20:31:50.695003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 292/563] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:50 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:51.715881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:51.716437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:51.722541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:51.723045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:51.723475 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:51.724361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:51.724879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:51.725395 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:51.871610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:51.880380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b73e63f8-023f-4ef8-bdc4-a73a3f29126d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.168255 Aug 29 20:31:51.880952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 272/564] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:51 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:52.902323 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:52.909108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:52.909842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:52.910311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:52.910743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:52.911421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:52.911868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:52.912496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:53.056303 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:53.064596 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dfaad38d-b2a2-46bc-873c-cb891215b590 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.166175 Aug 29 20:31:53.065164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 293/565] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:52 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:54.086149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:54.086763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:54.092894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:54.093377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:54.093816 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:54.094500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:54.094957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:54.095379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:54.235179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:54.243481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4fa0aa89-5f72-4c4f-8a3c-db8c0e8e1eba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.161238 Aug 29 20:31:54.244055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 273/566] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:54 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:55.264630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:55.265239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:55.271649 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:55.272128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:55.272590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:55.273272 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:55.273725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:55.274149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:55.414915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:55.423125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b1dbc322-d2cc-41d7-ba8f-cdd078777e66 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.162362 Aug 29 20:31:55.423699 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 294/567] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:55 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:56.445536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:56.446149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:56.452265 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:56.452751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:56.453324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:56.454014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:56.454513 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:56.454936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:56.593679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:56.602507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f0a32123-59a2-4c7c-ad88-75444584a69b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.161607 Aug 29 20:31:56.603073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 274/568] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:56 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:57.384672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1090111436", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "networks": [{"uuid": "0a8039e6-65a9-4c56-8616-376af6d97efa"}]}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:31:57.487875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] validate_networks() for [('0a8039e6-65a9-4c56-8616-376af6d97efa', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:31:57.624070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:57.624734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:57.630753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:57.631242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:57.632194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:57.632882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:57.633336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:57.633758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:57.830427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:57.838651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-54ef9d25-f892-45e5-802c-fd247ef51b8d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.218325 Aug 29 20:31:57.843014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 275/569] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:57 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:31:57.843972 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:31:57.844425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:31:57.845693 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:31:57.846111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:31:57.846528 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:31:57.855489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:57.856045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:57.856523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:57.857251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:57.857703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:57.858126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:57.875212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Getting quotas for project ac65a0d70d7045d183a8a725b304c169. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:31:57.879238 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Getting quotas for user 83efc8c932d04432ad3d0c974e0333a9 and project ac65a0d70d7045d183a8a725b304c169. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:31:57.890210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:31:57.894677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:31:58.018553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-adea76e1-28eb-4ab1-8b05-0b14bd13bb27 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637512 Aug 29 20:31:58.019119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 295/570] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:31:58.031752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d5bda4fd-b8c9-44dd-ba5e-f659c302cc73 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:58.032398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d5bda4fd-b8c9-44dd-ba5e-f659c302cc73 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:58.085856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5bda4fd-b8c9-44dd-ba5e-f659c302cc73 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:58.093387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d5bda4fd-b8c9-44dd-ba5e-f659c302cc73 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1219 microversion: 2.1 time: 0.065428 Aug 29 20:31:58.093963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 276/571] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:58 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:58.861105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:58.861717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:58.871662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:58.871662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:58.871662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:58.871662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:58.872856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:58.872856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:59.012859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:59.021781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f00aead0-ef95-4dcf-b23a-325ad89c950f tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.165172 Aug 29 20:31:59.022418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 296/572] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:58 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:31:59.113806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:31:59.114436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:31:59.121068 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:59.121548 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:59.122031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:59.122665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:31:59.123112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:31:59.123573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:31:59.186032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:31:59.194566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0d9b3f5d-6bb7-49f5-8ce1-8c691db3bbfd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1223 microversion: 2.1 time: 0.084053 Aug 29 20:31:59.195135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 277/573] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:31:59 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:00.043806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:00.044375 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:00.050749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:00.051236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:00.051674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:00.052387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:00.052844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:00.053778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:00.193990 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:00.202285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5c4a8e22-2f32-4fe1-bffd-e89d1c745a32 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.163413 Aug 29 20:32:00.202847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 297/574] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:00 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:00.218111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:00.218786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:00.224865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:00.225949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:00.226384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:00.227073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:00.227562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:00.227984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:00.290711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:00.298252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dbfb893a-0760-4c52-a3db-64fc0339decd tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1271 microversion: 2.1 time: 0.083949 Aug 29 20:32:00.298760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 278/575] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:00 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:01.223769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:01.224766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:01.231661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:01.232194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:01.232692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:01.233392 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:01.233852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:01.234362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:01.319156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:01.320320 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:01.326686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:01.327173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:01.327609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:01.328360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:01.328894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:01.329250 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:01.388616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:01.397170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1e2d3b54-2f49-4fb9-923c-82ef6ff5d7c9 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.177454 Aug 29 20:32:01.398181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 298/576] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:01 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:01.412449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:01.423814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-179ee6bc-fb8f-4d73-8004-5b65ca92b739 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1277 microversion: 2.1 time: 0.105633 Aug 29 20:32:01.423814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 279/577] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:01 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:02.418658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:02.419307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:02.426025 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:02.426520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:02.426955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:02.427655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:02.428112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:02.429051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:02.443121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:02.445348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:02.452154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:02.458920 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:02.458920 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:02.458920 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:02.458920 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:02.459296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:02.585878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:02.594536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ec7eac06-fea7-44b2-8ca8-3bd1e1e8fe4d tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.179629 Aug 29 20:32:02.595121 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 299/578] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:02 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:02.734524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:02.742373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d0da384d-fdee-498a-bfb3-34fc1a435503 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.303433 Aug 29 20:32:02.747896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 280/579] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:02 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:02.829681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25dd4de-4bf8-4091-b383-0959d0cce09c", "tag": "4d243f0b-d520-4504-87c6-36df9b2fe436"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:02.840676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:02.841083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:02.841517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:02.853308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] Creating event network-changed:4d243f0b-d520-4504-87c6-36df9b2fe436 for instance c25dd4de-4bf8-4091-b383-0959d0cce09c on hv-cinder-85200 Aug 29 20:32:02.858353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-652fc2b6-2dba-47e6-bd92-f8b6fed00828 req-35032bc3-b7a6-4e5f-8f4d-b7c613380a36 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039488 Aug 29 20:32:02.859073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 300/580] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:03.617177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:03.617806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:03.620039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:03.624719 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:03.625203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:03.625636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:03.626374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:03.626824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:03.627247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:03.764944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:03.765753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:03.770702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:03.773057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:03.773689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:03.774126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:03.774850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:03.775305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:03.775733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:03.779807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-87a71b8c-d9b0-4b1f-86bb-de9a5234805e tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.167270 Aug 29 20:32:03.780423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 281/581] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:03 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:03.910264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:03.917934 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-24c200ff-540a-494b-97e6-cb1cbceef5be tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.158153 Aug 29 20:32:03.918500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 301/582] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:03 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:04.801292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:04.801924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:04.809134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:04.809615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:04.810046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:04.810727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:04.811180 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:04.811599 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:04.938775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:04.939417 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:04.946292 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:04.946774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:04.947211 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:04.947902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:04.948385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:04.948811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:04.952227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:04.961195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4f515339-ba29-4d47-873f-7b8c06f3efae tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.163709 Aug 29 20:32:04.961771 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 282/583] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:04 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:04.964571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.044566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:05.047438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:05.053857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.054393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.054832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.055551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.055986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.056438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.089148 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:05.089406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a430631a-548a-44ac-b124-7479ab184bfa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051071 Aug 29 20:32:05.089917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 283/584] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:32:05 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:32:05.097442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ab9aab91-c333-4abe-ba8d-447dc38c7e72 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.162055 Aug 29 20:32:05.097560 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 302/585] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:04 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:05.152951 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:05.153456 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:05.159567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.160052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.160517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.161206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.161702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.162131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.185972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:32:05.346928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.588419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e0729b26-ff80-4901-96bc-4f9272ea12a3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 204 len: 0 microversion: 2.1 time: 0.438986 Aug 29 20:32:05.589036 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 284/586] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:32:05 2022] DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:32:05.597125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:05.597768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:05.604724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.605218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.605658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.606383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.606841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.607266 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.735149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:05.742922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a2545622-ed61-4d71-aa1c-46284f175d80 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1672 microversion: 2.1 time: 0.149620 Aug 29 20:32:05.743530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 303/587] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:05 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:05.982872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:05.983574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:05.990291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.990774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.991211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:05.991895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:05.992408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:05.992836 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:06.117996 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:06.118600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:06.125181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:06.125661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:06.126085 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:06.126766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:06.127211 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:06.127624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:06.146572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:06.155063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c2471886-f55d-486e-b824-9e895e0d213a tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.176439 Aug 29 20:32:06.162496 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 285/588] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:05 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:06.258789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:06.266406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c7cff579-7612-4b7b-98a2-8d99b7df47e0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.152782 Aug 29 20:32:06.266967 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 304/589] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:06 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:06.763448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:06.764105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:06.770171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:06.770653 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:06.771086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:06.772703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:06.773157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:06.773582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:06.901376 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:06.908969 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-44e05cc7-7e19-4914-af12-dac40548fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1672 microversion: 2.1 time: 0.149537 Aug 29 20:32:06.909557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 286/590] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:06 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:07.176181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:07.176805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:07.183339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.183820 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.184283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:07.184970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.185419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.185838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:07.286600 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:07.287203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:07.293062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.293552 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.293982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:07.294663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.295115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.295537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:07.325395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:07.333659 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3d53bb12-3e4d-48a2-a693-aca3f4115cba tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.161258 Aug 29 20:32:07.334353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 305/591] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:07 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:07.425350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:07.433110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a29db76a-b602-4688-ad95-ff7cd3837532 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.150182 Aug 29 20:32:07.433615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 287/592] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:07 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:07.931899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:07.932549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:07.934386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.935044 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=6 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.939717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.940337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.940779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:07.941465 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:07.941919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:07.942341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.077651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:08.082127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25dd4de-4bf8-4091-b383-0959d0cce09c", "name": "network-vif-plugged", "status": "completed", "tag": "4d243f0b-d520-4504-87c6-36df9b2fe436"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:08.082877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5ee3c743-85b6-4d9c-9194-4cad6921b1f5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1672 microversion: 2.1 time: 0.155239 Aug 29 20:32:08.090884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:08.093145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.093769 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.094203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.096702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 306/593] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:07 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:08.105860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] Creating event network-vif-plugged:4d243f0b-d520-4504-87c6-36df9b2fe436 for instance c25dd4de-4bf8-4091-b383-0959d0cce09c on hv-cinder-85200 Aug 29 20:32:08.111225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-72651c7c-6098-48fe-8139-54b1c5bf51b0 req-af43a6fa-1513-42fa-a64a-a0d7fa8431d9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033323 Aug 29 20:32:08.114387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 288/594] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:08.356305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:08.356849 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:08.363212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.363697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.364130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.364848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.365304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.365731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.454781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:08.455473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:08.465101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.465616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.466048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.466738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.467177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.467597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.509054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:08.517889 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5bbb9e81-7c8d-4ca7-a21b-8744b2bb42ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1756 microversion: 2.1 time: 0.165493 Aug 29 20:32:08.518474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 307/595] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:08 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:08.606371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:08.614432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f2af28f5-9eb5-419b-abe8-cf16c9097450 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.163824 Aug 29 20:32:08.616913 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 289/596] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:08 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:09.105914 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:09.106537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:09.112499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.113046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.113486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.114234 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.114796 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.115257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.252657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:09.260775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2e8e27bb-9e86-461a-ace3-715b54f3cba4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1672 microversion: 2.1 time: 0.158861 Aug 29 20:32:09.261367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 308/597] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:09 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:09.540239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:09.540887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:09.546779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.547260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.547695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.548416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.548871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.549301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.636493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:09.637106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:09.643928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.644455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.644891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.645583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:09.646054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:09.647423 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:09.698894 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:09.707237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b5b48417-73f9-4fcb-90e4-8a98b822db93 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1759 microversion: 2.1 time: 0.170942 Aug 29 20:32:09.707813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 290/598] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:09 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:09.781901 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:09.790121 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d7c3ebc0-0a98-46a5-97e9-9155c3f50874 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.157490 Aug 29 20:32:09.791024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 309/599] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:09 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:10.130833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cc3eff-660a-4cdb-93ec-9c5083607486", "name": "network-vif-deleted", "tag": "f5ff56a2-aee4-446c-bcb9-f9ea4afb3168"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:10.141466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:10.142093 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:10.142520 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:10.154985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] Creating event network-vif-deleted:f5ff56a2-aee4-446c-bcb9-f9ea4afb3168 for instance 01cc3eff-660a-4cdb-93ec-9c5083607486 on hv-cinder-85200 Aug 29 20:32:10.159884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-8ed6361e-8ea4-4e7a-9d3f-7395ec014790 req-a2e91598-d603-4ab2-8019-331017e28020 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Aug 29 20:32:10.160517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 291/600] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:10.282659 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:10.283504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:10.289968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:10.290452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:10.290889 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:10.291582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:10.292034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:10.292489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:10.355841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:10.365190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d39308f8-77ba-45da-8bf4-360f07d7d35d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1606 microversion: 2.1 time: 0.086256 Aug 29 20:32:10.372395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 310/601] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:10 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1606 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:10.813173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:10.813878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:10.820765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:10.821286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:10.822099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:10.822832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:10.823329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:10.823750 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:10.962291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:10.970199 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-191c3804-6361-46e7-9966-07d9f75e3bc6 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1319 microversion: 2.1 time: 0.161321 Aug 29 20:32:10.973185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 292/602] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:10 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:11.496116 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:11.497510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:11.502891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:11.503407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:11.503813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:11.504521 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:11.504977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:11.505403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:11.538502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:11.538905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:11.539336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:11.539825 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'fault' on Instance uuid 01cc3eff-660a-4cdb-93ec-9c5083607486 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:11.581337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:11.589911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e7eba2b1-feff-4307-ae4a-d4f6abf8e2c2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1327 microversion: 2.1 time: 0.206626 Aug 29 20:32:11.590551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 311/603] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:11 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:11.991888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:11.992539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:11.999029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:11.999520 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.000008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.000730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.001181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.001604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.148476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:12.156584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-65dc50a9-bc14-469a-a5b5-793e3942b9b0 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1509 microversion: 2.1 time: 0.169316 Aug 29 20:32:12.157154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 293/604] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:11 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:12.178851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f642ea1-7203-4d8a-895d-f31936b18829", "device": "/dev/sdb"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:12.181545 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:12.183864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:32:12.184011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c/os-volume_attachments (ip 10.222.0.85) !!! Aug 29 20:32:12.190547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.191066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.191533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.192277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.192734 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.193189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.610943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:12.611982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:12.618201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.618686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.619120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.619919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.620438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.620837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.654184 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:12.654627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:12.655451 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:12.656054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'fault' on Instance uuid 01cc3eff-660a-4cdb-93ec-9c5083607486 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:12.744152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:12.753864 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f25409b1-b2c3-4289-a871-0b2927219cea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1327 microversion: 2.1 time: 0.146841 Aug 29 20:32:12.754454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 294/605] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:12 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:13.598377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9f64c936-2e54-4ab0-9f31-b15c0c61d354 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "POST /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.423601 Aug 29 20:32:13.599376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 312/606] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:32:12 2022] POST /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c/os-volume_attachments => generated 194 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:13.775481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:13.776098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:13.782343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:13.782826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:13.783261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:13.783945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:13.786803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:13.786803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:13.817022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:13.817633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:13.818134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:13.818666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'fault' on Instance uuid 01cc3eff-660a-4cdb-93ec-9c5083607486 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:13.866802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:13.873798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1f3988f3-a4a1-4038-9a2a-ac233f7d0fc6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 200 len: 1327 microversion: 2.1 time: 0.102906 Aug 29 20:32:13.874365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 295/607] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:13 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:14.896456 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:14.900381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:14.904348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:14.904883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:14.905331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:14.906054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:14.906583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:14.907013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:14.920653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 HTTP/1.1 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:32:14.922248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:32:14.923994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '01cc3eff-660a-4cdb-93ec-9c5083607486'} Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:14.925205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:32:14.926736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:14.928112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:14.928112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-200c6d04-74cb-40f8-bc01-62d305257ed3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 404 len: 111 microversion: 2.1 time: 0.032438 Aug 29 20:32:14.928112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 313/608] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:14 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:32:14.932379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7caeb6f3-33c4-4fd5-b849-ec5470f11f33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '.version_select at 0x7f89876b1430>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:15.070726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7caeb6f3-33c4-4fd5-b849-ec5470f11f33 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170264495" status: 202 len: 0 microversion: 2.1 time: 0.142030 Aug 29 20:32:15.071313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 296/609] 10.222.0.85 () {58 vars in 1218 bytes} [Mon Aug 29 20:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170264495 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:32:15.561167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:15.561686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:15.567643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:15.568146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:15.568653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:15.569445 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:15.569906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:15.570336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:15.600913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-38bd41c5-5739-447a-a0f7-c4ded240ad8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments/0236d5c8-d5cc-454d-a426-7169edd0a35f" status: 200 len: 194 microversion: 2.20 time: 0.043771 Aug 29 20:32:15.601499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 314/610] 10.222.0.85 () {60 vars in 1454 bytes} [Mon Aug 29 20:32:15 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments/0236d5c8-d5cc-454d-a426-7169edd0a35f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:15.672888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:15.673389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:15.680014 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:15.680526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:15.680962 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:15.681669 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:15.682185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:15.682614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:15.767539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'services' on Instance uuid ebb79e74-0490-4071-80c8-c04cbea1da40 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:16.037011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eed51e61-d7d5-4cc6-8043-2a68daac2fc2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: .version_select at 0x7f89876e1550>, body: {"keypair": {"name": "tempest-keypair-494046821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCVfxXeLnGiGxN+Q+htHd8PaVNuuVL/SFF5r9LggMK+fWgmJqQvhaH7w/7e2WF5lGz7fdEINUSC80nYiAfs5MMzycsSltKqh1ei3BRvkGY2ZWTh7fJ6mxILH35Y1MsO+w=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:16.053561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-eed51e61-d7d5-4cc6-8043-2a68daac2fc2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:32:16.057746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-eed51e61-d7d5-4cc6-8043-2a68daac2fc2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for user 3f4b05a527e14d2599e03077c6c5f96f and project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:32:16.084652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a97f31a9-9622-4947-9d12-fb80ad3eb197 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments/0236d5c8-d5cc-454d-a426-7169edd0a35f" status: 202 len: 0 microversion: 2.20 time: 0.415611 Aug 29 20:32:16.085252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 297/611] 10.222.0.85 () {60 vars in 1457 bytes} [Mon Aug 29 20:32:15 2022] DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments/0236d5c8-d5cc-454d-a426-7169edd0a35f => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:32:16.093989 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:16.096363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:16.102541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:16.103022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:16.103460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:16.104146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:16.104652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:16.105075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:16.135438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cb6e73b1-ca0b-4b46-9bdc-e4bfc5674787 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045731 Aug 29 20:32:16.135991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 298/612] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:16 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:32:16.184753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-eed51e61-d7d5-4cc6-8043-2a68daac2fc2 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151506 Aug 29 20:32:16.185363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 315/613] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:32:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:17.148957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:17.151137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:17.157955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:17.158522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:17.158997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:17.159843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:17.160332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:17.160859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:17.191259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-77b6a275-5c10-4490-acfa-e2a1dd658572 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046825 Aug 29 20:32:17.192071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 299/614] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:17 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:18.204299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:18.206553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:18.213946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:18.214432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:18.214869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:18.215557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:18.216010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:18.216469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:18.248014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-17c922e5-2dd6-45fb-8838-cf1da20e6620 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Aug 29 20:32:18.248632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 316/615] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:18 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:19.091585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-135192331", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5109f79e-871b-4557-9678-62a9f5c0649c"}], "security_groups": [{"name": "tempest-securitygroup--1462009008"}], "key_name": "tempest-keypair-494046821", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:19.197360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] validate_networks() for [('5109f79e-871b-4557-9678-62a9f5c0649c', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:32:19.261807 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:19.263953 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:19.270936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:19.272373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:19.272850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:19.273566 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:19.274049 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:19.274526 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:19.304906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-02c2d759-871c-4640-8b09-30b3e0f3f195 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047476 Aug 29 20:32:19.305490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 317/616] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:19 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:19.620047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:32:19.620549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:32:19.621059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:32:19.621498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:32:19.621909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:32:19.633486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:19.633486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:19.633486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:19.633486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:19.633931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:19.634139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:19.652055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:32:19.656205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Getting quotas for user 3f4b05a527e14d2599e03077c6c5f96f and project 6adb6c50ed6c4fa5beebf037da1e73e7. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:32:19.667375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:32:19.669802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:32:19.905621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cae1d009-a2fc-4c94-9ab7-6b9c37be58b4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.818656 Aug 29 20:32:19.906322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 300/617] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:32:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:32:19.918971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a8689b19-c6b9-4432-8fd8-2acdaadcd387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:19.919612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a8689b19-c6b9-4432-8fd8-2acdaadcd387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:19.978765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a8689b19-c6b9-4432-8fd8-2acdaadcd387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:19.985138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a8689b19-c6b9-4432-8fd8-2acdaadcd387 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1236 microversion: 2.1 time: 0.070549 Aug 29 20:32:19.985882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 318/618] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:19 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:20.317934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:20.320792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:20.326824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:20.327302 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:20.327743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:20.328454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:20.328909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:20.329335 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:20.358254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-933a5161-df51-4f70-8257-110059650b4c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044741 Aug 29 20:32:20.358805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 301/619] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:20 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:21.007429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:21.008041 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:21.010637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:21.016036 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:21.016549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:21.016988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:21.017673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:21.018164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:21.018595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:21.080564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:21.089503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ef8aabcb-bc40-4a4d-9e27-d003c474db8c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1240 microversion: 2.1 time: 0.086498 Aug 29 20:32:21.090065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 319/620] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:21 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:21.371288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:21.373326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:21.379137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:21.379647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:21.380150 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:21.381471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:21.381928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:21.382365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:21.411541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9e1e888a-6713-40a6-8b05-78bd59280e4f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Aug 29 20:32:21.412617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 302/621] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:21 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:22.115182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:22.115783 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:22.122420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:22.122908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:22.123369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:22.124082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:22.124565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:22.124995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:22.128987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.188387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:22.196886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-549a32e3-b70e-4eca-a534-7f66f0a27daa tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1288 microversion: 2.1 time: 0.085939 Aug 29 20:32:22.197638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 320/622] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:22 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:22.424034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:22.426232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:22.432961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:22.433714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:22.434146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:22.434825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:22.435269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:22.435685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:22.440209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.465508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d4d21743-2aa5-4dff-a2a9-61e05daf30a4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045787 Aug 29 20:32:22.466104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 303/623] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:22 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:23.218154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:23.218766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:23.225883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:23.226369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:23.226803 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:23.227487 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:23.227941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:23.228400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:23.290773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:23.298255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-512a2951-3ae2-41e0-8a1b-47bbfd49a8c4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1288 microversion: 2.1 time: 0.083997 Aug 29 20:32:23.298822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 321/624] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:23 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:23.477270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:23.479354 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:23.485908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:23.486378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:23.486807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:23.487488 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:23.487934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:23.488422 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:23.517870 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ba28fd9b-9672-45e2-a6ef-e39cdf4695f0 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044780 Aug 29 20:32:23.518580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 304/625] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:23 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:24.319253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:24.319899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:24.326677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:24.327166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:24.327604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:24.328327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:24.328782 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:24.329208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:24.392548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:24.401081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1af6c27d-e3e9-4e52-a604-2b29f940cc16 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1288 microversion: 2.1 time: 0.085682 Aug 29 20:32:24.401644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 322/626] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:24 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:24.531034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:24.533214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:24.539813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:24.540337 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:24.540772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:24.541492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:24.541940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:24.542363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:24.571008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-be19d213-4dc6-476f-a8c0-6747dea72833 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043968 Aug 29 20:32:24.571499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 305/627] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:24 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:25.421609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:25.422220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:25.429164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:25.429648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:25.430080 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:25.430763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:25.431216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:25.431728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:25.492597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:25.500733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-689da9c0-a52d-4b4d-aa55-42ad4bf97392 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1288 microversion: 2.1 time: 0.083129 Aug 29 20:32:25.504206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 323/628] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:25 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:25.582972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:25.585752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:25.591739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:25.592278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:25.592720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:25.593404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:25.593885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:25.594310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:25.623374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6b3cf270-97e1-43aa-8378-87414f8c9c11 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044335 Aug 29 20:32:25.623942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 306/629] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:25 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:26.522000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:26.522673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:26.529637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:26.530206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:26.530642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:26.531339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:26.531792 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:26.532237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:26.605127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:26.610209 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-04d77b91-8607-4cb5-8776-7346629b205e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1296 microversion: 2.1 time: 0.092351 Aug 29 20:32:26.611005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 324/630] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:26 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:26.635844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:26.638141 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:26.644375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:26.644863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:26.645295 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:26.645995 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:26.646788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:26.647217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:26.680526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0b194bfb-576d-46c3-9cfe-9bb25b4eec7b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048144 Aug 29 20:32:26.684641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 307/631] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:26 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:32:27.631662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:27.632486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:27.638954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.639548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.640061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.640874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.641401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.641900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.692572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:27.695473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:27.716108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.716698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.717146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.717899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.718391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.718781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.758812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-efec585d-bae9-4105-90dc-0ffcb64dae91 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070459 Aug 29 20:32:27.759526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 308/632] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:32:27 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:27.812822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:27.821343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e6f2f94f-db2f-4f40-8b7b-c847977c1dbc tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.193583 Aug 29 20:32:27.821937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 325/633] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:27 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:27.827833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:27.828592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:27.835942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.836509 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.837125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.837817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:27.838276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:27.838697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:27.865361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:32:28.308095 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-498cad1e-db85-4b62-8ac8-eaeb2240aa6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 204 len: 0 microversion: 2.20 time: 0.483805 Aug 29 20:32:28.308646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 309/634] 10.222.0.85 () {60 vars in 1280 bytes} [Mon Aug 29 20:32:27 2022] DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:32:28.316754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:28.317367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:28.323486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:28.323973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:28.324434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:28.325116 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:28.325569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:28.325995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:28.457626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:28.465712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:28.467158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:28.468367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-15c565ca-5c11-4671-b0ee-2175bff3adcc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.155500 Aug 29 20:32:28.468925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 326/635] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:28 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:28.843834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:28.844582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:28.850566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:28.851043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:28.851481 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:28.852178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:28.852644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:28.853071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:28.985034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:28.993059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-953e5576-ebd2-4570-9253-acdb3004a54e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.153456 Aug 29 20:32:28.993630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 310/636] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:28 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:29.491173 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:29.491758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:29.498328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:29.498806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:29.499239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:29.499920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:29.500401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:29.500827 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:29.627583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:29.636213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:29.637705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:29.638874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c5ca3c70-1e01-46ac-8fbe-c316d292b22a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.151776 Aug 29 20:32:29.639456 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 327/637] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:29 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:30.014795 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:30.015406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:30.017381 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.018045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.023398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:30.023885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:30.024358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:30.025054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:30.025507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:30.030919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:30.160870 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:30.169083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-24f9e5e6-38d5-44e8-8060-e293a0efb162 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.158154 Aug 29 20:32:30.169651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 311/638] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:30 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:30.663544 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:30.664252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:30.666155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=6 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.671422 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:30.671910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:30.672380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:30.673073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:30.673527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:30.673955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:30.805664 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:30.813921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:30.815358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:30.816533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5955a988-4822-44b4-87f5-25bed9960be5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.157523 Aug 29 20:32:30.817095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 328/639] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:30 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:31.191358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:31.278134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:31.278134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:31.278134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:31.278134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:31.279233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:31.279233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:31.279233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:31.333588 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:31.341465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-65d07662-83f4-4148-99c8-1ca35f89f17a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.154438 Aug 29 20:32:31.347960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 312/640] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:31 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:31.501986 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94058bc-c764-424c-9f75-d2f3dc7ac8fe", "tag": "1755fcc0-0555-40d4-84c0-a6d6b62d20c8"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:31.511725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:31.512216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:31.512646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:31.523739 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] Creating event network-changed:1755fcc0-0555-40d4-84c0-a6d6b62d20c8 for instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe on hv-cinder-85200 Aug 29 20:32:31.534271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-47a14809-7950-4472-89ce-07817126b4eb req-6c8f206f-4e6d-4746-891f-423abe59b6ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086823 Aug 29 20:32:31.534271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 329/641] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:31.839404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:31.839935 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:31.845860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:31.846343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:31.846803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:31.847487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:31.847942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:31.848396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:31.983460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:31.991660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:31.993148 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:31.994360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5b08097b-dffa-47ed-bc50-4ada57ca6a23 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.158998 Aug 29 20:32:31.994911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 313/642] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:31 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:32.362977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:32.363767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:32.371256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:32.371749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:32.372208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:32.372892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:32.373348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:32.373771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:32.505689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:32.520909 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1b078198-976e-421c-a864-3efeae364322 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.162293 Aug 29 20:32:32.534650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 330/643] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:32 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:33.016965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:33.017558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:33.019401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.024938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:33.025451 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:33.025955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:33.026646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:33.027099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:33.027522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:33.377052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:33.386094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:33.387596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:33.388758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-17c9f5c3-add5-4151-874f-3b57a6c81e4b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1726 microversion: 2.20 time: 0.375828 Aug 29 20:32:33.389332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 314/644] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:33 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1726 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:33.541917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:33.542626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:33.549550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:33.550068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:33.550508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:33.551263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:33.551721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:33.552145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:33.697662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:33.705542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-669d3fe6-f89d-4ad8-a871-1a6ddab5079a tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.167464 Aug 29 20:32:33.706203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 331/645] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:33 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:33.932005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb79e74-0490-4071-80c8-c04cbea1da40", "name": "network-vif-deleted", "tag": "b75bfae3-43a8-4cdc-9cef-389992ed542f"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:33.942541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:33.943056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:33.943498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:33.960860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] Creating event network-vif-deleted:b75bfae3-43a8-4cdc-9cef-389992ed542f for instance ebb79e74-0490-4071-80c8-c04cbea1da40 on hv-cinder-85200 Aug 29 20:32:33.966215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-032fb7b6-e2f4-4802-8cdc-aa96062337aa req-44a2e1fd-d3f8-4c77-b1b6-27440d2da9f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039081 Aug 29 20:32:33.966814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 315/646] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:34.278987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:34.279489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:34.285346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.285831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.286262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.287027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.287477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.287898 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.371231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'services' on Instance uuid 01fc9fa6-a539-48d8-9953-d193eaf317d8 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:34.413275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:34.413978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:34.420560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.421047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.421556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.422384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.423003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.423585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.486960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:34.496248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:34.499147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:34.499147 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e608f166-7c71-459e-92a9-b5796e088710 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1658 microversion: 2.20 time: 0.090399 Aug 29 20:32:34.499585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 316/647] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:34 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1658 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:32:34.724620 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-bb5ff2c9-fcba-4cbf-bb36-df3663c7a114 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments/0225746d-0327-418d-a3b2-b83d8c44f479" status: 202 len: 0 microversion: 2.1 time: 0.449732 Aug 29 20:32:34.725370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 332/648] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:32:34 2022] DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments/0225746d-0327-418d-a3b2-b83d8c44f479 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:32:34.728100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:34.728885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:34.734372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:34.742474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.742474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.742474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.742972 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:34.743078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.743078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.743078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.744804 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.745308 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.745733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.746431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:34.746874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:34.747297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:34.781838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f09cf470-5135-44ef-aa83-66d80b0915cc tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051784 Aug 29 20:32:34.782412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 333/649] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:32:34 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:34.885287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:34.891083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5e06e1d1-720d-4181-804b-ab62089d538e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.168562 Aug 29 20:32:34.891657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 317/650] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:34 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:35.019283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:35.019766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:35.026054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.026529 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.026964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.027681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.028126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.028567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.114626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lazy-loading 'services' on Instance uuid c25dd4de-4bf8-4091-b383-0959d0cce09c {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:35.461678 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ff6f42a0-5721-4e55-907d-82ef5b8cd867 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c/os-volume_attachments/7f642ea1-7203-4d8a-895d-f31936b18829" status: 202 len: 0 microversion: 2.1 time: 0.447259 Aug 29 20:32:35.462399 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 334/651] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:32:35 2022] DELETE /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c/os-volume_attachments/7f642ea1-7203-4d8a-895d-f31936b18829 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:32:35.522162 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:35.522924 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:35.529035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.529516 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.529978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.530703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.531157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.531608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.563169 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.563934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.564449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.564896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'fault' on Instance uuid ebb79e74-0490-4071-80c8-c04cbea1da40 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:35.567740 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.605834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:35.613987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:35.616055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:35.617232 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bb650c43-2f22-46ff-abd6-2ad5e1bebc64 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1372 microversion: 2.20 time: 0.099205 Aug 29 20:32:35.617789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 318/652] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:35 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:35.795379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:35.797536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:35.803555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.804038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.804504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.805194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.805643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.806066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.837260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b07a9d9e-8408-440e-838d-e9584faaa7ed tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 Aug 29 20:32:35.837826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 335/653] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:32:35 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:35.914461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:35.915102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:35.921732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.922245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.922979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:35.923407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:35.923861 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:35.924314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.061610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:36.069757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-768264a8-1ce7-4439-8c47-e8c33f1fb5f4 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.161417 Aug 29 20:32:36.070322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 319/654] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:35 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:36.639242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:36.639798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:36.645866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:36.647246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:36.647680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.648393 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:36.648848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:36.649270 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.653344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:36.680274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:36.680758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:36.681192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.681636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'fault' on Instance uuid ebb79e74-0490-4071-80c8-c04cbea1da40 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:36.722596 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:36.730604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:36.732037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:36.733201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fefecd39-0c0e-455f-bd45-bfda37370fa4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 200 len: 1372 microversion: 2.20 time: 0.098229 Aug 29 20:32:36.733760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 336/655] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:36 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:36.849535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:36.851817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:36.858401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:36.858882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:36.859462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.860282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:36.860749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:36.861174 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:36.891739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-19d9e8ff-ef8d-4443-acd5-96d8a8d4e5f9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Aug 29 20:32:36.892359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 320/656] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:32:36 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:37.090994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:37.091611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:37.098119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.098612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.099060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.100434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.100892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.101319 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.232245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:37.239953 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5dd6e130-7bfd-469d-b97e-ab788154ca31 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.153173 Aug 29 20:32:37.240632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 337/657] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:37 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:37.755393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:37.756004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:37.762172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.762651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.763085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.763796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.764308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.764735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.778679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 HTTP/1.1 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:32:37.780377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:32:37.782060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'ebb79e74-0490-4071-80c8-c04cbea1da40'} Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:37.783077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:32:37.784609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:37.786122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:37.786122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f178f013-ba7d-4e34-b9fd-8a06bbe1fead tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 404 len: 111 microversion: 2.20 time: 0.030331 Aug 29 20:32:37.786122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 321/658] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:37 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:32:37.791957 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-618582a0-ac96-4a01-b921-86e01a3da9f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '.version_select at 0x7f89876e1940>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:37.907237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:37.909586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:37.916420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.916910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.917346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.918054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:37.918503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:37.918926 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:37.947439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f07a1d8f-be49-4141-9912-c658ed72a41a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044976 Aug 29 20:32:37.948007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 322/659] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:32:37 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:32:37.972721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-618582a0-ac96-4a01-b921-86e01a3da9f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332194894" status: 204 len: 0 microversion: 2.20 time: 0.185105 Aug 29 20:32:37.973530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 338/660] 10.222.0.85 () {60 vars in 1262 bytes} [Mon Aug 29 20:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332194894 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:32:38.029427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:38.029927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:38.037033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.037758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.038362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.039074 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.039539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.039955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.065480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:32:38.261869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:38.262616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:38.269988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.270662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.271954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.272900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.273349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.273766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.496988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9a721f2c-5cd3-4591-b847-280367f68af6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 204 len: 0 microversion: 2.1 time: 0.471046 Aug 29 20:32:38.497591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 323/661] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:32:38 2022] DELETE /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:32:38.506807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:38.512446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:38.513522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.514012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.514452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.515146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.515601 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.516027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.573129 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:38.582584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-570b3fa4-afc9-48c7-92db-202db588abbd tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.325267 Aug 29 20:32:38.583481 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 339/662] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:38 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:38.651599 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:38.659748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a069bed1-9167-4cf3-ab9c-60bbba6e3e20 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.157884 Aug 29 20:32:38.660798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 324/663] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:38 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:38.709192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:38.709616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:38.715421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.715900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.716370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.717060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:38.717507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:38.718115 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:38.746068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:32:38.999255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5c2b4258-62da-4007-a2a6-16eb086fd36b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: .version_select at 0x7f89878eca60>, body: {"keypair": {"name": "tempest-keypair-1753962524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLJhDQQmTVA6CjUJTfzXSA+x5fX6nYetEUX1qpnH4BLYggPLKzABc8Q3m0vjxXM4CdBZTvVLbciMTqWonbNtTNA4cEH45YuVEOhL/roWdh3OFI2oWPfoJ/gk1oB3ciQLw=="}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:39.014271 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-5c2b4258-62da-4007-a2a6-16eb086fd36b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for project e6f51ffa08494524b47ac220f1bd74de. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:32:39.018302 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-5c2b4258-62da-4007-a2a6-16eb086fd36b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for user 859d36aa86bd403ca1d46b245efaef61 and project e6f51ffa08494524b47ac220f1bd74de. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:32:39.144007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5c2b4258-62da-4007-a2a6-16eb086fd36b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148681 Aug 29 20:32:39.144638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 325/664] 10.222.0.85 () {62 vars in 1200 bytes} [Mon Aug 29 20:32:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 20:32:39.159912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d64be07d-96c9-4e91-a285-f27caa4d7620 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 204 len: 0 microversion: 2.1 time: 0.454439 Aug 29 20:32:39.160563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 340/665] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:32:38 2022] DELETE /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:32:39.168522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:39.169138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:39.175081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.175558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.175990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.176710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.177655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.178096 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.305247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:39.313192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f5ebaa0c-9974-4788-98bf-f70da4988a4a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.148508 Aug 29 20:32:39.313761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 326/666] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:39 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:39.604222 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:39.604879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:39.611397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.611897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.612385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.613076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.613555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.613978 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.682051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:39.683124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:39.689589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.690152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.690656 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.691582 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:39.692110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:39.692658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:39.755160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:39.762901 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-83f592a8-103a-4326-9eaa-40c80102cbb5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.163573 Aug 29 20:32:39.763467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 341/667] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:39 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:39.824847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:39.834500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c4177c89-d6f2-4e40-a593-a20d0661ebc3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.157335 Aug 29 20:32:39.835129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 327/668] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:39 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:40.166113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94058bc-c764-424c-9f75-d2f3dc7ac8fe", "name": "network-vif-plugged", "status": "completed", "tag": "1755fcc0-0555-40d4-84c0-a6d6b62d20c8"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:40.178145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.178618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.179039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.190541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] Creating event network-vif-plugged:1755fcc0-0555-40d4-84c0-a6d6b62d20c8 for instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe on hv-cinder-85200 Aug 29 20:32:40.196471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-7d9ee9bd-45fb-41b9-8a14-6f99fafc0309 req-fe43becc-3dde-4460-8aa5-e95424fecddc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Aug 29 20:32:40.197052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 342/669] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:40.335024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:40.335664 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:40.342790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.343464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.344494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.344965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.345583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.346402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.495789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:40.503728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c8617f50-e359-4bba-a3e9-53548726460c tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.172593 Aug 29 20:32:40.504331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 328/670] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:40 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:40.784758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:40.785372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:40.792212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.792690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.793122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.793801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.794248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.794668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.857783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:40.858793 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:40.865501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.866113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.866662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.867560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:40.868191 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:40.868786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:40.931771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:40.940042 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f9f148d3-9d28-4a41-9b35-5eee8b7c5bf6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.160001 Aug 29 20:32:40.940666 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 343/671] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:40 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:41.318104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:41.326101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c65e3209-5ccd-4305-b936-21e62597edb9 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.472463 Aug 29 20:32:41.326684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 329/672] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:40 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:41.525347 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:41.526052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:41.532218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:41.532748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:41.538185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:41.538185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:41.538185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:41.538185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:41.673079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:41.682019 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8bc2e127-4b77-4fe5-bbe9-ea2485bcc909 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.161308 Aug 29 20:32:41.682819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 344/673] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:41 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:41.961576 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:41.965156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:41.968217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:41.968736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:41.969170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:41.969897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:41.970378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:41.970812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:42.184731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:42.192502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7c347046-a3c9-4ed1-88c8-a19d7f6b3bbf tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.235393 Aug 29 20:32:42.193134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 330/674] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:41 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:42.347555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:42.348181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:42.355354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:42.355843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:42.364451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:42.364451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:42.364451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:42.364451 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:42.494571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:42.502642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-496df246-4412-4617-9dcd-98e8d9a096cb tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.158907 Aug 29 20:32:42.504967 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 345/675] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:42 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:42.660194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-573484368", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "437ad417-2104-45df-a56d-2f84426e2ca3"}], "security_groups": [{"name": "tempest-securitygroup--2057662132"}], "key_name": "tempest-keypair-1753962524", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:42.702874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:42.703338 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:42.709918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:42.710403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:42.710845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:42.711565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:42.711979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:42.712425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:42.764453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] validate_networks() for [('437ad417-2104-45df-a56d-2f84426e2ca3', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:32:42.845707 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:42.854191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0390b6b3-9ec2-4bd7-9c5e-917c1c71bd9a tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.155307 Aug 29 20:32:42.854773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 346/676] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:42 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:43.138875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:32:43.139346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:32:43.139792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:32:43.140211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:32:43.140695 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:32:43.151566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.152098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.152566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.153353 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.153833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.154258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.171138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for project e6f51ffa08494524b47ac220f1bd74de. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:32:43.175060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Getting quotas for user 859d36aa86bd403ca1d46b245efaef61 and project e6f51ffa08494524b47ac220f1bd74de. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:32:43.186037 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:32:43.188322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:32:43.213874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:43.214485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:43.220364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.223350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.223350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.223350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.223350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.223715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.345927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b7ade4b4-6b0c-4943-8430-5fbfc3bfae44 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.690041 Aug 29 20:32:43.351767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 331/677] 10.222.0.85 () {62 vars in 1188 bytes} [Mon Aug 29 20:32:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 20:32:43.357465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:43.358077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:43.362524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:43.373194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4f17746f-a3b3-4d6b-9043-f6ea5abeae4b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.163145 Aug 29 20:32:43.375003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 347/678] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:43 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:43.417684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:43.425028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:43.426485 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:43.427626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-275af185-1859-4414-822b-7c9225f941a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1281 microversion: 2.20 time: 0.074042 Aug 29 20:32:43.428373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 332/679] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:43 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:43.530781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:43.531421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:43.537277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.537757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.538189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.538880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.539330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.539750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.668760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:43.676469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-281a26d0-a315-4c19-abff-fc7b5680fec5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.149684 Aug 29 20:32:43.677519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 348/680] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:43 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:43.875124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:43.875735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:43.883024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.883506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.883938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:43.884679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:43.885132 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:43.885558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.018822 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:44.027406 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-83bbaa99-0acd-4bf8-8acf-43ba87da93ff tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.156112 Aug 29 20:32:44.028309 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 333/681] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:43 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:44.397670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:44.398224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:44.404758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.405241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.405675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.406364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.406812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.407236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.450362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:44.451066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:44.457188 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.457749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.458301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.459000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.459459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.459884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.522347 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:44.530945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:44.532139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:44.533275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c9eedc02-e829-42ea-b03f-c5284efd47fc tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1285 microversion: 2.20 time: 0.086913 Aug 29 20:32:44.533838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 334/682] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:44 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:32:44.542973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:44.551291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a1c00754-4131-4b10-a9f0-e55e859a0edb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.157942 Aug 29 20:32:44.551859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 349/683] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:44 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:44.698248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:44.698862 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:44.705286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.705770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.706212 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:44.706937 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:44.707394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:44.707886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.048824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:45.049432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:45.056480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.056954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.057389 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.058143 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.058618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.059013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.103960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.116864 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-93c472ec-1da9-44d2-96ee-fb2a8d5a9ca5 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1686 microversion: 2.1 time: 0.422330 Aug 29 20:32:45.117473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 335/684] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:44 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1686 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:45.197573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.205321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-63efe343-6cbb-4e50-a5e4-b944b260c3d1 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1515 microversion: 2.1 time: 0.160464 Aug 29 20:32:45.205956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 350/685] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:45 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:45.556856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:45.557709 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:45.563626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.564107 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.564593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.565281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.565734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.568396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.573377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:45.574891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:45.582534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.583052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.584565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.585506 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.586206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.586903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.651124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.656091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:45.661401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.662956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.664753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1be2d16a-cc63-47ab-a6ea-e860c1a8a05f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1333 microversion: 2.20 time: 0.112442 Aug 29 20:32:45.667652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 336/686] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:45 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:45.734012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:45.741878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9d465975-98af-44f2-9b15-46842b7cb2ea tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.172618 Aug 29 20:32:45.742450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 351/687] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:45 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:45.759136 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25dd4de-4bf8-4091-b383-0959d0cce09c", "name": "network-vif-deleted", "tag": "4d243f0b-d520-4504-87c6-36df9b2fe436"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:45.768896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:45.769407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:45.769837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:45.782154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] Creating event network-vif-deleted:4d243f0b-d520-4504-87c6-36df9b2fe436 for instance c25dd4de-4bf8-4091-b383-0959d0cce09c on hv-cinder-85200 Aug 29 20:32:45.787390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-69a07463-4c3d-4736-86b4-1a8d41947ecb req-17dd43fd-7f15-40b9-90ff-dae4110ba846 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 29 20:32:45.788012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 337/688] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:46.138816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:46.140086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:46.151183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.152150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.152878 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.153831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.154520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.155229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.174322 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.224599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.230615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:46.231831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:46.235748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fbae0fa1-6700-4d8b-be97-59f27f6e899a tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1619 microversion: 2.1 time: 0.101109 Aug 29 20:32:46.236768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 352/689] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:46 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1619 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:46.242875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.243440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.244946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.244946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.252418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.253595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.327997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.337255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4a1fdfd0-7821-4c59-b9af-e7e108619468 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1304 microversion: 2.1 time: 0.114077 Aug 29 20:32:46.338228 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 338/690] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:46 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:46.688343 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:46.689788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:46.697586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.699911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.700455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.701239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.701822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.702277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.763747 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:46.764405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:46.780653 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.781412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.782017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.782892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:46.783589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:46.784262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:46.796723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.806117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.813364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.814679 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-26acae09-2431-446a-beb1-734a802ce530 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1333 microversion: 2.20 time: 0.130243 Aug 29 20:32:46.818655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 353/691] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:46 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1333 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:32:46.954883 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:46.963098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0d173214-173d-4b48-904c-dcbe2ff9fe59 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1362 microversion: 2.1 time: 0.204212 Aug 29 20:32:46.963681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 339/692] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:46 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:47.264133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:47.264801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:47.270870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.271359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.272083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.272799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.273252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.273675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.358086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:47.358689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:47.363169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:47.365124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.365612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.366044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.366730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.367280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.367708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.376443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f55bba1c-b18d-4e16-9732-003de7c463a2 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1329 microversion: 2.1 time: 0.116100 Aug 29 20:32:47.377627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 354/693] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:47 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:47.407314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.407942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.408524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.409154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lazy-loading 'fault' on Instance uuid c25dd4de-4bf8-4091-b383-0959d0cce09c {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:47.456770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83efc8c932d04432ad3d0c974e0333a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac65a0d70d7045d183a8a725b304c169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:47.465467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-89028fa7-861c-4217-a38d-eaee0125c03b tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 200 len: 1309 microversion: 2.1 time: 0.111450 Aug 29 20:32:47.466038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 340/694] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:47 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:47.801512 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fc9fa6-a539-48d8-9953-d193eaf317d8", "name": "network-vif-deleted", "tag": "5da7ccdb-f51d-444d-aee2-d49f304337be"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:47.812714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.813253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.813691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.824836 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] Creating event network-vif-deleted:5da7ccdb-f51d-444d-aee2-d49f304337be for instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 on hv-cinder-85200 Aug 29 20:32:47.829664 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-0f8c0af1-c9d7-4469-ab59-4a21e6ed513d req-66ec343e-493d-401b-884f-dd4e08dce935 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032334 Aug 29 20:32:47.830446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 355/695] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:47.840106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:47.840735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:47.846696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.847175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.847611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.848327 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.849336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.849748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.924998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:47.934315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:47.935881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:47.937252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5db4bcc4-e696-492c-adbd-a8f29378efe7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1341 microversion: 2.20 time: 0.101052 Aug 29 20:32:47.938063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 341/696] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:47 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1341 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:47.984385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:47.985178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:47.992285 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.992806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.993376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:47.994104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:47.994558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:47.994981 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.140210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:48.148694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2af557e0-ff05-4fec-92a0-07cc701d19c5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1547 microversion: 2.1 time: 0.168539 Aug 29 20:32:48.149262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 356/697] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:47 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:48.169085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:48.169579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:48.175654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.176134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.176684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.177469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.177965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.178391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.298112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ba259cdf-37dd-4d90-b8f3-207f51cbda9c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132765 Aug 29 20:32:48.298954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 342/698] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:32:48 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:48.399768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:48.400499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:48.426509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.431341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.433486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.435787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.437102 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.437980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.480875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.481662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.487507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:48.488116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] [instance: c25dd4de-4bf8-4091-b383-0959d0cce09c] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:48.491985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.492488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'fault' on Instance uuid 01fc9fa6-a539-48d8-9953-d193eaf317d8 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:48.498537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.499024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.501064 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.501064 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.501064 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.501064 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.520020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] HTTP exception thrown: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Request method failure captured: Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c HTTP/1.1 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSHUnnn_aDP186v-hXff-gap0BCTd3ZZkYA04Q8_sInkuSrO2Ogpa0sD2hXI2vW2ac1pwfOYU--2rj5me-ClRulIqNh5gAGoFYom3Toc1gVa8OflVWTJuAuYV-rMW9oArNNRnRiXnZyUYA7-xBkVSnQyw4tr0KYLGt1nIza-AmGhkvM Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: ac65a0d70d7045d183a8a725b304c169 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:32:48.521996 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ac65a0d70d7045d183a8a725b304c169"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ac65a0d70d7045d183a8a725b304c169", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: ac65a0d70d7045d183a8a725b304c169 Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1011589115 Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesSnapshotTestJSON-1011589115-project Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 83efc8c932d04432ad3d0c974e0333a9 Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesSnapshotTestJSON-1011589115-project Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. Aug 29 20:32:48.523403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'c25dd4de-4bf8-4091-b383-0959d0cce09c'} Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:48.524143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. Aug 29 20:32:48.525389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.538368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] Returning 404 to user: Instance c25dd4de-4bf8-4091-b383-0959d0cce09c could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:48.538368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ce009c65-9b3a-42f2-8c2d-6a52ebd85517 tempest-VolumesSnapshotTestJSON-1011589115 tempest-VolumesSnapshotTestJSON-1011589115-project] 10.222.0.85 "GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c" status: 404 len: 111 microversion: 2.1 time: 0.040401 Aug 29 20:32:48.538368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 343/699] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:48 2022] GET /compute/v2.1/servers/c25dd4de-4bf8-4091-b383-0959d0cce09c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:32:48.574689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:48.591253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-65692a90-4798-46da-90fa-61cd081a4d05 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 200 len: 1334 microversion: 2.1 time: 0.195786 Aug 29 20:32:48.592955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 357/700] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:48 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:48.959742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:48.960352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:48.966448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.966940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.967373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:48.968080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:48.968562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:48.968987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:49.194853 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:49.206823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:49.209259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:49.210434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-963b2476-9d7c-46aa-a7cb-aff6317a976e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.255371 Aug 29 20:32:49.210942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 344/701] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:48 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:49.621015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:49.621662 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 01fc9fa6-a539-48d8-9953-d193eaf317d8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:49.628523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:49.629393 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:49.629868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:49.631143 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:49.631610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:49.632023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:49.649593 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] HTTP exception thrown: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Request method failure captured: Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 HTTP/1.1 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEdbr0UBGbc1Dkaicuy7soLHnPMv1dFKhKkjv81PWp3YW63sX1CUZXNW9OLOr9Eyg9B9cw0aWHIPuvvwgwdcnR9ZuLbR3nPeFnw_xLx5hYb8NDNwdcbazd1ADSsE11RR6IaYtXMWJ8eX4_p2qgfPRSHVug8lNZHOXLJTqaFF-H52ig Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:32:49.651252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_66be3e70cbf742269fe9306a7b7e8fe0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 336345e5437341ba9859d776c44ea4be Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. Aug 29 20:32:49.652976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '01fc9fa6-a539-48d8-9953-d193eaf317d8'} Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:49.653756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. Aug 29 20:32:49.655217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.660034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Returning 404 to user: Instance 01fc9fa6-a539-48d8-9953-d193eaf317d8 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:49.660034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7e644b6c-9a7c-4c64-8e1a-e2b06dd9f737 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8" status: 404 len: 111 microversion: 2.1 time: 0.035791 Aug 29 20:32:49.660034 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 358/702] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:49 2022] GET /compute/v2.1/servers/01fc9fa6-a539-48d8-9953-d193eaf317d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:32:49.667235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cf0bb706-772b-448f-b525-1fe857ec9e12 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '.version_select at 0x7f89875cf8b0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:49.674590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:49.762580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cf0bb706-772b-448f-b525-1fe857ec9e12 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792825005" status: 202 len: 0 microversion: 2.1 time: 0.099061 Aug 29 20:32:49.764206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 345/703] 10.222.0.85 () {58 vars in 1218 bytes} [Mon Aug 29 20:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792825005 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:32:49.777507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94058bc-c764-424c-9f75-d2f3dc7ac8fe", "tag": "1755fcc0-0555-40d4-84c0-a6d6b62d20c8"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:49.787282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:49.788018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:49.788640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:49.800023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] Creating event network-changed:1755fcc0-0555-40d4-84c0-a6d6b62d20c8 for instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe on hv-cinder-85200 Aug 29 20:32:49.806086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-16c345c1-be2d-4315-bd05-78ea9d63db4e req-4f7113e4-3111-45d8-bc2c-d24adbe8cdba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Aug 29 20:32:49.806668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 359/704] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:50.234193 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:50.235752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:50.246501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:50.248182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:50.248801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:50.249679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:50.250296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:50.252079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:50.519653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:50.532988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:50.534053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:50.534691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:50.537115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:50.545399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:50.546840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] Creating event network-changed:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:32:50.547274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:50.548606 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-271b1adc-41a8-4b7b-88c3-f245123ee6f4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.318711 Aug 29 20:32:50.561006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 346/705] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:50 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:50.562358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-c2a6f488-871a-4c44-a5e2-d34d48249b5c req-b0d3d4e3-d9d3-46e7-affa-3af0c260497e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047765 Aug 29 20:32:50.563182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 360/706] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:51.574589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:51.575191 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:51.581503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:51.581981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:51.588049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:51.588049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:51.588049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:51.588049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:51.714815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:51.722881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:51.724848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:51.728077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-48132c0a-5fa9-4855-87ba-65769157be97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.155578 Aug 29 20:32:51.728077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 347/707] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:51 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:52.312232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:52.312848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:52.314737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:52.320213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.320704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.321144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.321843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.322281 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.322728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.346395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lazy-loading 'flavor' on Instance uuid cef448e4-4c7d-4e0b-8542-864ad660beb8 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:52.748764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:52.749411 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:52.756326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.756872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.757323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.758026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.758400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-75c6ac65-347e-464d-b41e-d2140318612f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "POST /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8/action" status: 202 len: 0 microversion: 2.1 time: 0.450904 Aug 29 20:32:52.758507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.758900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.762315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 361/708] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:32:52 2022] POST /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:32:52.767400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:52.768095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:52.774463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.774947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.775382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.776069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:52.776591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:52.777018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:52.892743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:52.902608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:52.904059 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:52.905211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f172bb50-6a7e-4e25-947a-7a560001dc74 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.160683 Aug 29 20:32:52.905780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 348/709] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:52 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:32:52.918821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:52.926831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-52eec239-5246-46cb-977b-95dbe655ebec tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.163460 Aug 29 20:32:52.927457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 362/710] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:52 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:53.928963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:53.929574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:53.931431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.936641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=12 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.936837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:53.937323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:53.937761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:53.938450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:53.938907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:53.939332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:53.948504 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:53.949134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:53.955146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:53.955622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:53.956061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:53.956759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:53.957207 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:53.957626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:54.076488 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:54.085370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:54.086910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:54.088128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6ef15bea-b7a6-4188-8511-cf9d454b97bb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.163855 Aug 29 20:32:54.088801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 349/711] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:53 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:32:54.093869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:54.101752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e1d9a14e-540f-4b36-8ce9-d24ba6844f78 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.157333 Aug 29 20:32:54.102314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 363/712] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:53 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:55.110235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.110837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:55.116837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.117355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.117978 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.118469 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.126547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.126547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.126776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.126776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:55.130334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.130813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.131241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.131923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.132398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.132812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.258736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:55.266828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:55.268322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:55.269434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b79a9463-4ffa-430c-82bc-42853fcf696e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.163168 Aug 29 20:32:55.270001 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 350/713] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:55 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:55.278539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:55.287073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7177220d-1c93-4830-a60b-095c0e897097 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.167887 Aug 29 20:32:55.287632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 364/714] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:55 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:55.652713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.653209 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:55.659056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.659535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.660020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.660729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:55.661321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:55.661747 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:55.687680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:32:56.056766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f357340d-8e83-45c8-b53d-c1aaa1c34306 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 204 len: 0 microversion: 2.1 time: 0.407726 Aug 29 20:32:56.057350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 351/715] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:32:55 2022] DELETE /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:32:56.065335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:56.066300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:56.073404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.073879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.074310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.074985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.075431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.075882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.214673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:56.222407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e692ed0-e5dc-4707-86db-5f54e5bade6d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1507 microversion: 2.1 time: 0.160888 Aug 29 20:32:56.222964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 365/716] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:56 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:56.292895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:56.293629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:56.299523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.300000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.300465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.311455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.311455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.311455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.311749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:56.311749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:56.314540 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.315019 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.315453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.316133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:56.316612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:56.317164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:56.441742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:56.450715 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:56.452156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:56.453009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:56.453283 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e9dd4d0f-0d1f-44ac-a485-04355f52e223 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.164778 Aug 29 20:32:56.464235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 352/717] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:56 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:56.464424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-331d15b6-2380-4cd7-944a-163a48a018ab tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.156741 Aug 29 20:32:56.464424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 366/718] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:56 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:57.243714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:57.244337 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:57.250317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.250795 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.251230 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.251906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.252392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.252813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.380448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:57.388488 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-02b4edfd-8d93-419e-ba35-b276ddcb0d8d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1507 microversion: 2.1 time: 0.149111 Aug 29 20:32:57.389050 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 353/719] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:57 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:57.487128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:57.487128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:57.487663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:57.488337 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:57.488840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.489404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.489993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.490693 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.491204 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.491637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.494665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.495149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.495586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.496304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:57.496761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:57.497182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:57.501388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:57.630071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:57.630349 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:57.638270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-42e677dc-8601-4b41-a836-a0fd7bab43f9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.154594 Aug 29 20:32:57.638535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:57.639037 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 354/720] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:57 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:32:57.639982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:57.641131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-10c88bf1-50aa-4085-bf98-47ac4a37c957 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.164137 Aug 29 20:32:57.641682 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 367/721] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:57 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:58.410109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:58.410723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:58.417623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.418116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.422356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.422356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.422356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.422356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.526258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2136121277"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:58.526810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:58.533542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.534307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.534751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.535464 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.535920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.536455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.644156 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:58.659275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e87ca9be-a814-43ca-be01-17ef4b12ba29 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1507 microversion: 2.1 time: 0.252889 Aug 29 20:32:58.659889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 355/722] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:58 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:58.668747 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:58.700270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:58.700270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.700270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.700270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.700674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.700674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.700674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.718461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.network.security_group_api [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Removing security group b3f5eb80-9642-4864-9187-ecaa99c24bd7 from port 5c074101-5a5e-40f6-b6e6-70b660e8c958 Aug 29 20:32:58.839849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:58.847787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-be25df7d-350c-47c2-a2d0-4d67bf1604ae tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.184276 Aug 29 20:32:58.848383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 356/723] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:58 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:58.852852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:58.853453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:58.859171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.859655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.860092 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:58.860832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:58.861287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:58.861711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.070581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:59.078506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:59.079948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:59.081083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5137aaa1-ab12-4246-8f62-dfe06a1ca546 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.231758 Aug 29 20:32:59.081645 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 357/724] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:32:58 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:59.086742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6", "name": "network-vif-deleted", "tag": "355949a2-ff90-4219-bf66-26b294916862"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:59.095892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.096429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.096871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.111022 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] Creating event network-vif-deleted:355949a2-ff90-4219-bf66-26b294916862 for instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 on hv-cinder-85200 Aug 29 20:32:59.115890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-0ace1090-0981-4675-9e9c-df34a010300d req-b6e2474b-cca5-4f6e-ac6d-08b28821769c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Aug 29 20:32:59.116564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 358/725] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:59.251331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-cbf7c01d-f307-4b8f-bfa7-bfbc866fc103 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.732936 Aug 29 20:32:59.251968 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 368/726] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:32:58 2022] POST /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:32:59.279521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:59.291119 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.291594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.292354 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.304623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] Creating event network-changed:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:32:59.309930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-37b9846b-0aac-4568-bf30-897c1449627e req-0935cf40-7933-4c92-a496-0d9aaa56e6c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034472 Aug 29 20:32:59.311808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 359/727] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:59.718618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.722182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:59.733936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.734911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.735814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.737098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.737806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.747817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.785673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.786865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.787304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.787794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'fault' on Instance uuid ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:32:59.790670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:59.840474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:32:59.860793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5d5fe6cf-4915-47f3-96eb-d7cc1578c7a0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1312 microversion: 2.1 time: 0.151329 Aug 29 20:32:59.863420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 369/728] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:59.883870 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.885979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:32:59.895680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.896307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.897015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:59.897724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:59.898185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:59.898614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.111168 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.113550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:00.135940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.137781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.139499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.143938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.146045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.152245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.268112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:00.279597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2d3d389c-18b3-45ad-958a-3489c373f78c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.404813 Aug 29 20:33:00.280466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 360/729] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:00.562763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:00.584236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:00.585697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:00.586855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4d3e2c2b-bbcd-4a44-9fdd-7a22f7052bc4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.486357 Aug 29 20:33:00.587415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 370/730] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:00.724680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "name": "network-vif-plugged", "status": "completed", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:00.733975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.734442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.734864 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.747790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] Creating event network-vif-plugged:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:33:00.752621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-83582c0d-10c0-4357-9067-b2c341c8c81c req-72fdd520-9ce1-4d3f-8f0d-d442b79b632f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091212 Aug 29 20:33:00.753369 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 361/731] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:00.886675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.887289 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:00.902754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.904992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.905543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.906333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.906743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.907176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.941318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:00.941813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:00.942367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:00.943320 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'fault' on Instance uuid ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:01.021397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:01.032356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b74953b5-8470-4b45-8233-4f25dba9f3e1 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 200 len: 1312 microversion: 2.1 time: 0.149596 Aug 29 20:33:01.033494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 371/732] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:01.146972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.147557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:01.153739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.154223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.154661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.155364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.155804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.156257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.236089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lazy-loading 'services' on Instance uuid bdebb54f-a649-4301-8309-aed598d57a2e {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:01.302684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.303621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:01.321311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.321961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.322516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.323348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.323906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.324576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.465539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:01.476553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8a1529b6-2d05-4a27-9ae9-f635aa13cd4a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.178438 Aug 29 20:33:01.477290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 372/733] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:01.482320 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:01.493029 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.493510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.493945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.505320 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] Creating event network-changed:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:33:01.510185 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-da0d56d1-d9fa-4411-8392-d3dd9e31eac8 req-50cfe7e0-4700-40fb-8a9b-74407dd61943 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 Aug 29 20:33:01.510761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 373/734] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:01.613048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.613760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:01.621004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.621551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.621996 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.622705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.622908 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ccdaa3a7-78f4-47b0-98ab-9d5306ff4027 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments/13f896f0-6200-4d53-87d0-c3143c56b3c7" status: 202 len: 0 microversion: 2.1 time: 0.480337 Aug 29 20:33:01.623164 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.623588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.623697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 362/735] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:33:01 2022] DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments/13f896f0-6200-4d53-87d0-c3143c56b3c7 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:33:01.633766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.636056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:01.642998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.643623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.644292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.645158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:01.645644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:01.646069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:01.679541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7d21782e-38c0-4195-8bd5-e99aaf4bb0f5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051136 Aug 29 20:33:01.684245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 363/736] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:01.768230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:01.776990 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:01.778512 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:01.779732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-463cd099-c55c-4ca9-a37d-f44c8ac49581 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.171740 Aug 29 20:33:01.780554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 374/737] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:02.055286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.055889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.061984 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.062467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.062896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.063584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.064027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.064478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] HTTP exception thrown: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Request method failure captured: Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 HTTP/1.1 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEdbr0UBGbc1Dkaicuy7soLHnPMv1dFKhKkjv81PWp3YW63sX1CUZXNW9OLOr9Eyg9B9cw0aWHIPuvvwgwdcnR9ZuLbR3nPeFnw_xLx5hYb8NDNwdcbazd1ADSsE11RR6IaYtXMWJ8eX4_p2qgfPRSHVug8lNZHOXLJTqaFF-H52ig Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:33:02.082858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_66be3e70cbf742269fe9306a7b7e8fe0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 336345e5437341ba9859d776c44ea4be Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. Aug 29 20:33:02.084517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6'} Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:02.085414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. Aug 29 20:33:02.086800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:33:02.088129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Returning 404 to user: Instance ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:02.088129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f26ef125-80bb-48a2-af29-725acf2ead96 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6" status: 404 len: 111 microversion: 2.1 time: 0.030988 Aug 29 20:33:02.088129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 364/738] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/servers/ccc91d37-20f5-4e46-b3eb-56b9b23fc0b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:02.090472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.090969 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.097865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.099050 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.099489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.100214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.100673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.101098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.127537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:33:02.498286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.498912 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.504922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.505403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.506549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.507480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.507947 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.508410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.600084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-14722e2c-a9f9-4844-99c6-65bf51876ae3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "DELETE /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 204 len: 0 microversion: 2.1 time: 0.513142 Aug 29 20:33:02.600706 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 375/739] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:33:02 2022] DELETE /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:33:02.609053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.609879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.616022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.616602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.617100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.617863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.618360 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.618912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.642785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:02.651567 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-530fc237-bef2-477f-8730-e8426fede67e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.157181 Aug 29 20:33:02.652145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 365/740] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:02.693086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.695566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.702038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.702307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.702742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.703437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.703889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.704342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.734818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6350dc02-5333-4842-bc9a-cf0a7102ef56 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 29 20:33:02.735407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 366/741] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:02.753979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:02.760331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-41d8733f-0a34-4415-9281-22a35686b762 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.155320 Aug 29 20:33:02.760891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 376/742] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:02.802301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:02.803012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:02.808988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.809599 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.810103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.810776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:02.811221 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:02.811698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:02.941255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:02.949868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:02.951525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:02.952684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a7750eea-5616-4b09-b341-c19a2dd56f6c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.154396 Aug 29 20:33:02.953252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 367/743] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:03.673437 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:03.674049 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:03.681093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.683797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.683797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.683797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.683797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.684183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.746433 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:03.752644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:03.754477 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.755462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.755895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.756607 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.757058 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.757479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.787487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a726f408-c016-4b23-be1f-fe91bff14285 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Aug 29 20:33:03.792113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 368/744] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:03 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:03.792415 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:03.793008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:03.798564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.799043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.799476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.800159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.800634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.801060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.818457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:03.826115 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b09e7b64-9e78-4146-8c97-7d4a1ac2aac0 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.156494 Aug 29 20:33:03.826644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 377/745] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:03 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:03.927593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:03.935219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e71b4dc4-a13a-425f-8012-4523677378f0 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.146217 Aug 29 20:33:03.935804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 369/746] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:03 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:03.976769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:03.977771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:03.984471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.984954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.985382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:03.986060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:03.986509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:03.986928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.118026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:04.126116 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:04.127503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:04.128629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fb9ae6c9-f1d7-49fb-89bb-9b16d37e9c9e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.156936 Aug 29 20:33:04.129184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 378/747] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:03 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:04.799850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:04.802665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:04.808805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.809284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.809724 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.810409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.810863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.811285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.839864 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cbf2237b-b361-4b14-884a-2e6cac773501 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 29 20:33:04.840435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 370/748] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:04 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:04.848009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:04.848660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:04.855026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.855500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.855928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.856686 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.857134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.857549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.956887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:04.957666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:04.963854 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.964454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.964999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.965712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.966166 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.966590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.992623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:05.000579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-01c7de41-3175-4776-9829-dc7c2075b8d8 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.156337 Aug 29 20:33:05.001173 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 379/749] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:04 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:05.096745 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:05.105000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d0e7f5a1-3c41-4e9b-9e0f-fef7c2dd79ee tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.151999 Aug 29 20:33:05.105563 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 371/750] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:04 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:05.151923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:05.152575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:05.158434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.158912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.159342 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.160020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.160497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.160946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.298458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:05.306557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:05.307988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:05.309183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-745089e6-4717-4710-934b-522ea8baadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.161139 Aug 29 20:33:05.309709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 380/751] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:05 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:33:05.852728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:05.854962 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:05.860952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.861435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.861875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.862554 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.863010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.863436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.888235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:05.892926 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-66ac25cf-72f6-49e3-a664-2b64e2c64e82 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Aug 29 20:33:05.893507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 372/752] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:05 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:06.021259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.022141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.028567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.034365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.034365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.034365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.034365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.034744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.126524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.127142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.134266 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.134753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.135190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.135889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.136382 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.136817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.180284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.181562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-00d70724-a19b-4b07-a7db-77d6a5ad59f2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.164128 Aug 29 20:33:06.182143 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 381/753] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:06.269280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.277895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-15380cd1-b4bd-4ccf-9413-1c96757c41c6 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.155468 Aug 29 20:33:06.278470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 373/754] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:06.332239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.333386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.339186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.339668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.340103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.340805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.341256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.341676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.469927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.478752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.480427 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.481555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f29bd919-70d4-421d-a538-eda71fe4162d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.153174 Aug 29 20:33:06.482117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 382/755] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:06.905486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.907639 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.914241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.914726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.915167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.915859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.916362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.916789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.945089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e88d593f-0fa7-4187-8726-aef7c57293ce tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Aug 29 20:33:06.945641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 374/756] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:07.202680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.203300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:07.210231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.213906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.213906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.213906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.213906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.214297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.298901 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.299546 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:07.305852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.306339 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.306776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.307473 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.307930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.308410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.347668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.355635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b45c0999-47cd-470e-a085-5c19f687e23d tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.156702 Aug 29 20:33:07.356243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 383/757] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:07.438866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.447289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9488a48c-a561-4d78-8b92-d426bab41248 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.152178 Aug 29 20:33:07.447936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 375/758] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:07.503633 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.504261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:07.510697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.511183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.511617 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.512326 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.512778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.513200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.644059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.646394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:07.653245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.654687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.655787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-96dd1de3-9555-4757-ad3e-fe46d0a326c5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1407 microversion: 2.20 time: 0.156024 Aug 29 20:33:07.656379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 384/759] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:07.958589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.960765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:07.966645 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.967182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.979783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.979783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.979783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.979783 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.998676 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7929ec7f-9108-4512-a256-d3965e22d5a6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Aug 29 20:33:07.999205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 376/760] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:08.377611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.378352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.387804 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.392059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.392059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.392059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.392059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.392520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.469228 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.469878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.476379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.476872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.477339 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.478251 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.478707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.479139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.536424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.544187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7c83292c-e8c7-4cd1-a1d6-ea76af5dda28 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.170747 Aug 29 20:33:08.544762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 385/761] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:08.620460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.627276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b7d25f40-ff1f-45a8-bf97-e57cffea455d tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.161929 Aug 29 20:33:08.627925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 377/762] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:08.680292 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.680891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.687262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.687811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.688297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.689100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.689680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.690258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.823378 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.831695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.833966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.835142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b7e4f6ca-b673-4691-86f5-3f92b2f26cd4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1600 microversion: 2.20 time: 0.160299 Aug 29 20:33:08.835767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 386/763] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:08.857972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.858702 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.865317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.865798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.872672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.872672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.872672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.872672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.945861 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-49b4163c-e46e-4532-9942-b2ed40728298 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091816 Aug 29 20:33:08.946466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 378/764] 10.222.0.85 () {60 vars in 1316 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:33:09.011177 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.013470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.019551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.021564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.021564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.021564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.022227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.022425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.053374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fc4587b5-4ef8-4e15-bf21-043150e5ac11 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Aug 29 20:33:09.053999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 387/765] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:09.565964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.566573 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.574389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.574877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.575311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.576043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.576521 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.576949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.649241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.650043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.656612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.657105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.657543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.658458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.658965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.659396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.831913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:09.841033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-87ef504b-5069-452a-b31d-d9797f4117f4 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1520 microversion: 2.1 time: 0.195804 Aug 29 20:33:09.842567 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 388/766] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:10.006387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:10.014216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d6b8fd09-09de-4656-bb30-47ff7eb92496 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.452094 Aug 29 20:33:10.015008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 379/767] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:10.066131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:10.068970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:10.078087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.078893 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.079326 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.080028 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.084899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.084899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.117850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2cefc54d-0389-45cb-9b24-f2f681d1cc26 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055998 Aug 29 20:33:10.118750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 389/768] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:10 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:10.775254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abe1ad-59b4-43ae-9922-b7ec7820a7b6", "name": "network-vif-deleted", "tag": "4e4b5b30-5bc4-4141-962d-67cc0c57eb5b"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:10.784900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.785374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.786379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.799055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] Creating event network-vif-deleted:4e4b5b30-5bc4-4141-962d-67cc0c57eb5b for instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 on hv-cinder-85200 Aug 29 20:33:10.804535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-decd6bb4-dce2-40c3-92a1-293681621344 req-08ad786d-835e-491c-8744-c9b028749257 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Aug 29 20:33:10.805185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 380/769] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:10.862847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:10.864474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:10.875302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.875302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.875302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.875302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.875944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.875944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.943189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:10.951495 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-96569c2d-8f4e-48a2-ba7b-cb9497d50f93 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1478 microversion: 2.1 time: 0.092386 Aug 29 20:33:10.952010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 390/770] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:10 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1478 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:11.036108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.036843 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.043189 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.043684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.044122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.045090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.045735 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.046165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.131369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.134045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.140974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.141845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.142335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.143245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.143914 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.144536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.179220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3b648a0e-e390-4457-9ab1-69d0a7105c3b tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052632 Aug 29 20:33:11.180440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 391/771] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:33:11.190721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.203970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.203970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.203970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.203970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.205060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.205060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.205060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.221409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:11.230028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-95376f7a-7748-47e2-936c-ae4c377b37db tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.198191 Aug 29 20:33:11.230700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 381/772] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:11.287071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] HTTP exception thrown: Instance bdebb54f-a649-4301-8309-aed598d57a2e is not attached to volume 13f896f0-6200-4d53-87d0-c3143c56b3c7 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Request method failure captured: Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments/13f896f0-6200-4d53-87d0-c3143c56b3c7 HTTP/1.1 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSGtYPjme9Qwu7qO6wwVZdETTYYqFWm6msjCCQML4pftAFDAjZ682ND8R-occO49HjMVvTjL063vkHKX2fSnSQzbhznFlU7VueSv5DB_92m7SoT6NNgCsLapizr5BX8bQq3kjuX7IKOzpk7WakvbEldhfKZnHbXa4m20V5Qv9eGdVUQ Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 0931206111ba46198d58746f57266c23 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:33:11.289472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0931206111ba46198d58746f57266c23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0931206111ba46198d58746f57266c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0931206111ba46198d58746f57266c23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0931206111ba46198d58746f57266c23", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 0931206111ba46198d58746f57266c23 Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-TestMinimumBasicScenario-476974756-project Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: e82c9e9f4ca742abb6531b3210be3776 Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-TestMinimumBasicScenario-476974756-project Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:33:11.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance bdebb54f-a649-4301-8309-aed598d57a2e is not attached to volume 13f896f0-6200-4d53-87d0-c3143c56b3c7 Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'server_id': 'bdebb54f-a649-4301-8309-aed598d57a2e', 'id': '13f896f0-6200-4d53-87d0-c3143c56b3c7'} Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 13f896f0-6200-4d53-87d0-c3143c56b3c7. Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:11.292184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdebb54f-a649-4301-8309-aed598d57a2e is not attached to volume 13f896f0-6200-4d53-87d0-c3143c56b3c7 Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdebb54f-a649-4301-8309-aed598d57a2e is not attached to volume 13f896f0-6200-4d53-87d0-c3143c56b3c7 Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:11.293473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Returning 404 to user: Instance bdebb54f-a649-4301-8309-aed598d57a2e is not attached to volume 13f896f0-6200-4d53-87d0-c3143c56b3c7 {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:11.294749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-de0a7cba-9dbf-4b52-8a88-9f51846b3c85 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments/13f896f0-6200-4d53-87d0-c3143c56b3c7" status: 404 len: 154 microversion: 2.1 time: 0.104364 Aug 29 20:33:11.294749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 392/773] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:33:11 2022] DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e/os-volume_attachments/13f896f0-6200-4d53-87d0-c3143c56b3c7 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:33:11.976251 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.976868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.982746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.983242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.983662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.984386 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.984846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.985269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.015774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.016306 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.016740 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.017205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lazy-loading 'fault' on Instance uuid 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:12.065375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336345e5437341ba9859d776c44ea4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66be3e70cbf742269fe9306a7b7e8fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:12.069751 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0831753f-be29-46a4-9549-cd94a6cea87e tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 200 len: 1311 microversion: 2.1 time: 0.097387 Aug 29 20:33:12.070461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 382/774] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:12.251295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:12.251818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:12.258942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.259435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.259874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.260605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.261061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.261488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.399857 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:12.408076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9b847c32-81fa-46de-86d9-68e2a9575f75 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.160667 Aug 29 20:33:12.408961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 393/775] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:12 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:12.780137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:12.780652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:12.786885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.787381 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.787809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.788531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.788976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.789390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.814112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:33:12.827900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:12.838051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.838529 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.838973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.851188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] Creating event network-changed:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:33:12.856234 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-fc3638b6-08b8-40d9-a7b2-5157342bd2bc req-56c1eae1-8aba-44c0-8271-6154b0c1a68d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Aug 29 20:33:12.856943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 394/776] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:13.092588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.093320 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] [instance: 61abe1ad-59b4-43ae-9922-b7ec7820a7b6] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.100452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.101026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.101537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.102309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.102838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.104114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.118563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] HTTP exception thrown: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Request method failure captured: Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 HTTP/1.1 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEdbr0UBGbc1Dkaicuy7soLHnPMv1dFKhKkjv81PWp3YW63sX1CUZXNW9OLOr9Eyg9B9cw0aWHIPuvvwgwdcnR9ZuLbR3nPeFnw_xLx5hYb8NDNwdcbazd1ADSsE11RR6IaYtXMWJ8eX4_p2qgfPRSHVug8lNZHOXLJTqaFF-H52ig Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:33:13.120111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/66be3e70cbf742269fe9306a7b7e8fe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_66be3e70cbf742269fe9306a7b7e8fe0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 66be3e70cbf742269fe9306a7b7e8fe0 Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546544472 Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 336345e5437341ba9859d776c44ea4be Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546544472-project Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. Aug 29 20:33:13.121776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '61abe1ad-59b4-43ae-9922-b7ec7820a7b6'} Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:13.122590 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. Aug 29 20:33:13.123806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:13.125014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] Returning 404 to user: Instance 61abe1ad-59b4-43ae-9922-b7ec7820a7b6 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:13.125014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-054412ac-d068-44e2-8a05-378b2900a4e3 tempest-ServerRescueNegativeTestJSON-1546544472 tempest-ServerRescueNegativeTestJSON-1546544472-project] 10.222.0.85 "GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6" status: 404 len: 111 microversion: 2.1 time: 0.033337 Aug 29 20:33:13.125014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 395/777] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/61abe1ad-59b4-43ae-9922-b7ec7820a7b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:33:13.245655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ae8ff372-ff13-43be-bdd7-4d8e20d87fa6 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 204 len: 0 microversion: 2.1 time: 0.469187 Aug 29 20:33:13.246366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 383/778] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:33:12 2022] DELETE /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:33:13.255022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.262632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.263012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.263503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.263938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.264658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.265117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.265545 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.398228 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:13.405985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e3374890-38ec-40f2-87e5-704f0790f0c5 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1554 microversion: 2.1 time: 0.155331 Aug 29 20:33:13.406660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 396/779] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:13.431259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.432044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.438076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.438634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.439140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.439911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.440474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.441063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.967739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:13.968646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-737e15cd-0ca5-4516-8434-c6a8b928c94b tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.541386 Aug 29 20:33:13.969310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 384/780] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:14.428795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:14.429403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:14.435937 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.436471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.436917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.437610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.438052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.438471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.575750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:14.589038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d12d0a7d-bf1d-4b49-8e85-28dc463349c2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1554 microversion: 2.1 time: 0.163262 Aug 29 20:33:14.600221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 397/781] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:14 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:14.990728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:14.991341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:14.997681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.998169 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.998605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.999297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.000015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.000155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.280100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:15.288479 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e4357d01-7904-4eee-a6b9-82e6be9d2697 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.301770 Aug 29 20:33:15.299859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 385/782] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:14 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:15.613199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:15.616245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:15.627005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.627835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.628680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.629905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.630572 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.631242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.861499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:15.871153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d515a7b0-533c-408e-8055-9e466e304ef2 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1554 microversion: 2.1 time: 0.264297 Aug 29 20:33:15.877691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 398/783] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:15 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:16.309308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:16.310052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:16.316662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.317151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.317584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.318280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.318728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.319161 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.508835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdebb54f-a649-4301-8309-aed598d57a2e", "name": "network-vif-deleted", "tag": "5c074101-5a5e-40f6-b6e6-70b660e8c958"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:16.523415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.530145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.530145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.539672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] Creating event network-vif-deleted:5c074101-5a5e-40f6-b6e6-70b660e8c958 for instance bdebb54f-a649-4301-8309-aed598d57a2e on hv-cinder-85200 Aug 29 20:33:16.548250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6d15bcc4-a357-425c-8f2e-52d76f1cc807 req-3572f177-bb32-4af3-8265-5b1f475f912b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043115 Aug 29 20:33:16.548850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 399/784] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:16.555851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:16.568766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f0d83788-a10b-4eec-b83d-81a1b9b23b08 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.263423 Aug 29 20:33:16.576249 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 386/785] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:16 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:16.897460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:16.898165 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:16.908031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.908564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.909513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.910415 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.910888 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.911291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.016087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:17.024266 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d740f54a-1492-40d8-926d-e395ebfd8653 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1512 microversion: 2.1 time: 0.131207 Aug 29 20:33:17.025128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 400/786] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:16 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1512 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:17.591000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:17.591781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:17.593874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:17.600056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.613043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.613043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.613043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.613043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.614255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.015106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:18.025874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5434ba9c-7e06-4699-a6b8-883dd175870f tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.438750 Aug 29 20:33:18.026683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 387/787] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:17 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:18.045842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:18.046453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:18.054163 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.054652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.055091 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.055788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.056277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.056693 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.137712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:18.147244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3986f69e-206e-4e5d-b1c5-33d84c9177bc tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1343 microversion: 2.1 time: 0.104952 Aug 29 20:33:18.150510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 401/788] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:18 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1343 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:19.047343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:19.048020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:19.054049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.055506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.058360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.060764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.061490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.062135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.089013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:19.168887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:19.170084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:19.176799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.180432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.180432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.180432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.180432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.180819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.215990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:19.221099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.221621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.222090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.222708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lazy-loading 'fault' on Instance uuid bdebb54f-a649-4301-8309-aed598d57a2e {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:19.225438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1e14a829-5720-412e-90ca-ebbe17d27657 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.181206 Aug 29 20:33:19.225438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 388/789] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:19 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:19.268706 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c9e9f4ca742abb6531b3210be3776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931206111ba46198d58746f57266c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:19.277485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-611fc605-1691-4803-9fc4-e2ef7a1035b8 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 200 len: 1348 microversion: 2.1 time: 0.112603 Aug 29 20:33:19.278056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 402/790] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:19 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:20.246276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.246884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.253380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.254553 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.255210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.256199 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.256815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.257397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.302280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "name": "network-vif-unplugged", "status": "completed", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:20.321769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.322522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.323127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.335230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:20.337638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] Creating event network-vif-unplugged:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:33:20.343155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-aaa9f26f-ae7b-44d1-a687-88beeed407b5 req-cee3c01e-cd8e-402d-b95c-6e953f6a4d70 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046147 Aug 29 20:33:20.344057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 403/791] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:20.353181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.353954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] [instance: bdebb54f-a649-4301-8309-aed598d57a2e] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.361057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.361652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.364385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.364385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.364385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.364385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.378943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] HTTP exception thrown: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Request method failure captured: Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e HTTP/1.1 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSGtYPjme9Qwu7qO6wwVZdETTYYqFWm6msjCCQML4pftAFDAjZ682ND8R-occO49HjMVvTjL063vkHKX2fSnSQzbhznFlU7VueSv5DB_92m7SoT6NNgCsLapizr5BX8bQq3kjuX7IKOzpk7WakvbEldhfKZnHbXa4m20V5Qv9eGdVUQ Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 0931206111ba46198d58746f57266c23 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:33:20.381334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0931206111ba46198d58746f57266c23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0931206111ba46198d58746f57266c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0931206111ba46198d58746f57266c23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0931206111ba46198d58746f57266c23", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 0931206111ba46198d58746f57266c23 Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-TestMinimumBasicScenario-476974756 Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-TestMinimumBasicScenario-476974756-project Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: e82c9e9f4ca742abb6531b3210be3776 Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-TestMinimumBasicScenario-476974756-project Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. Aug 29 20:33:20.382998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'bdebb54f-a649-4301-8309-aed598d57a2e'} Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:20.383975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. Aug 29 20:33:20.385471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:33:20.386795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Returning 404 to user: Instance bdebb54f-a649-4301-8309-aed598d57a2e could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:20.386795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9ade6f34-2f04-416c-9f4e-6a32af5b9ecf tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e" status: 404 len: 111 microversion: 2.1 time: 0.034822 Aug 29 20:33:20.387218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 404/792] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:20 2022] GET /compute/v2.1/servers/bdebb54f-a649-4301-8309-aed598d57a2e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:20.392460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c6324df4-9f71-4482-9f11-668182cb19e3 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] Calling method '.version_select at 0x7f8987630790>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.402419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:20.423675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:20.432818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f903b9a7-3ad7-44ab-80fa-22f7462a52b9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1568 microversion: 2.1 time: 0.191127 Aug 29 20:33:20.443991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 389/793] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:20 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:20.457634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:20.458557 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.466403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.467129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.467776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.469574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.470423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.471680 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.508522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121468) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:33:20.526377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c6324df4-9f71-4482-9f11-668182cb19e3 tempest-TestMinimumBasicScenario-476974756 tempest-TestMinimumBasicScenario-476974756-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-142280226" status: 202 len: 0 microversion: 2.1 time: 0.137944 Aug 29 20:33:20.528905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 405/794] 10.222.0.85 () {58 vars in 1269 bytes} [Mon Aug 29 20:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-142280226 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:33:20.975123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5dacf2f7-2105-4008-a9f6-035033f97ee2 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "POST /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8/action" status: 202 len: 0 microversion: 2.1 time: 0.520990 Aug 29 20:33:20.976422 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 390/795] 10.222.0.85 () {60 vars in 1278 bytes} [Mon Aug 29 20:33:20 2022] POST /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:33:20.986220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.987277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.994401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.995058 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.995674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.996574 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.997188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.998039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:21.138973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:21.154851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-07d844d0-9e87-4868-a999-66e6bea35915 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1516 microversion: 2.1 time: 0.174194 Aug 29 20:33:21.163708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 406/796] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:20 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:22.177480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:22.178086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:22.184551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.185031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.185463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.186170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.186618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.187038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.335106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:22.335106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-72240fcb-6e2c-49d6-8d2c-af7ed1c7ad12 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1516 microversion: 2.1 time: 0.155075 Aug 29 20:33:22.335106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 391/797] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:22 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:23.349950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:23.350583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:23.357677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:23.358269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:23.358710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:23.359406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:23.359861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:23.360317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:23.496044 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:23.504038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c26cfdc1-9f95-4459-984b-a836a3dd6a77 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1518 microversion: 2.1 time: 0.158000 Aug 29 20:33:23.504651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 407/798] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:23 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:24.525830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:24.526439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:24.533104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.533807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.534396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.535798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.536438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.537051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.770786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:24.779470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d07e279f-cc5c-4eb0-814f-e6c33edceab9 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1518 microversion: 2.1 time: 0.257896 Aug 29 20:33:24.780131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 392/799] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:24 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:25.800899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:25.810556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:25.810556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:25.810556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:25.810556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:25.810905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:25.810905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:25.810905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:25.987078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:25.998288 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5aa2a6d5-865f-4889-9239-254b172abc0e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.201184 Aug 29 20:33:25.998875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 408/800] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:25 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:27.021361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:27.022220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:27.031465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.032558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.033259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.035000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.035737 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.036528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.215352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:27.232988 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b8cd52c2-2207-47ae-87cf-96fbbfdbf8a1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.216222 Aug 29 20:33:27.233590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 393/801] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:27 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:28.254973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:28.255597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:28.262724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.263406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.263847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.264602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.265057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.265675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.703443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:28.718020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-717a17d6-1bf8-4d83-94dc-374ea4e29200 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.466958 Aug 29 20:33:28.725514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 409/802] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:28 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:29.745644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-991a80ae-07eb-4279-be46-e2fdf0dab970 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: .version_select at 0x7f898760e940>, body: {"keypair": {"name": "tempest-keypair-1475278595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHOlGwLsFnZOaroaTgkaEeiVCG+ddvujF3JjFV03AHHwc/VxdT1GSMOUpioH3Zf8yHaTI8k/OZrxUYSU1A4JLyD5BULgznRFC3vqKLikulStyFhsaP/InDxbUpemtJX4A=="}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:29.746906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:29.748045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:29.755054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.755533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.756154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:29.757027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.757484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.757940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:29.761826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-991a80ae-07eb-4279-be46-e2fdf0dab970 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:29.765891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-991a80ae-07eb-4279-be46-e2fdf0dab970 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:29.932314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-991a80ae-07eb-4279-be46-e2fdf0dab970 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313715 Aug 29 20:33:29.932922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 394/803] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:33:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:29.980666 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:29.997015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d6e02cef-00d9-4ecf-b65a-7cbd4a524d18 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.254149 Aug 29 20:33:29.998025 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 410/804] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:29 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:31.019214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:31.022143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:31.031351 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:31.032191 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:31.032848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:31.033802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:31.034509 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:31.035190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:31.238198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:31.246314 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3a75bed1-e81b-4bed-b247-944746711715 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.231433 Aug 29 20:33:31.247539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 395/805] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:31 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:32.275416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:32.275416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:32.281073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.281858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.283489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.286092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.286795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.287595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.519024 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:32.531046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-07c1909f-00f9-4896-bbd4-31ffb1a4b996 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.265666 Aug 29 20:33:32.532214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 411/806] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:32 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:33.162173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-768077328", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e83db8-f1ae-4fb9-8271-926f248d148a"}], "security_groups": [{"name": "tempest-securitygroup--1586781859"}], "key_name": "tempest-keypair-1475278595", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:33.265852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] validate_networks() for [('f1e83db8-f1ae-4fb9-8271-926f248d148a', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:33:33.302133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:33.304765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:33.317966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.320736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.321344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.322223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.323126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.325588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.366656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2a66335f-65ad-4998-9b21-08622f62948d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/ips" status: 200 len: 144 microversion: 2.1 time: 0.069344 Aug 29 20:33:33.367242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 412/807] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:33:33 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/ips => generated 144 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:33.553569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:33.554205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:33.560353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.560863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.561279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.561969 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.562418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.563033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.682944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:33:33.683372 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:33:33.683888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:33:33.684550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:33:33.684959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:33:33.694729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.695239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.695678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.696436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.696895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.697317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.715054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:33.719167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:33.727763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:33.731497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:33:33.734038 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:33:33.740262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b958e497-d47c-4491-b502-aa82fba4b12a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.190713 Aug 29 20:33:33.742576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 413/808] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:33 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:33.887820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e23463a0-063f-44ac-8cf4-6a55128f9623 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730505 Aug 29 20:33:33.888525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 396/809] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:33:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:33:33.899538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f84a2181-b0f0-4475-8bf1-23087ffd3c19 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:33.900442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f84a2181-b0f0-4475-8bf1-23087ffd3c19 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:33.957265 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f84a2181-b0f0-4475-8bf1-23087ffd3c19 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:33.964636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f84a2181-b0f0-4475-8bf1-23087ffd3c19 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1241 microversion: 2.1 time: 0.069188 Aug 29 20:33:33.965200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 414/810] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:33 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:34.762697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:34.763303 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:34.769657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:34.771086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:34.771210 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:34.771779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:34.772522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:34.772943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:34.915586 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:34.923726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b75ace6f-3acc-441b-b2c0-e0b298223077 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.165084 Aug 29 20:33:34.924430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 397/811] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:34 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:34.985997 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-97a73da6-1b84-4814-a4db-71dbbd001023 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:34.992600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-97a73da6-1b84-4814-a4db-71dbbd001023 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.065826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-97a73da6-1b84-4814-a4db-71dbbd001023 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:35.074184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-97a73da6-1b84-4814-a4db-71dbbd001023 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1241 microversion: 2.1 time: 0.091973 Aug 29 20:33:35.074939 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 415/812] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:34 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:35.188635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f6285a9-cd1a-4e73-b8b9-9dea3c623a44"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:35.191046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.197863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.198350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.198802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.199467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.199919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.200378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.946599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:35.947198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.953159 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.953642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.954073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.954753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.955201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.955621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.092103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:36.099874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-089c9425-63f8-44c6-9120-31c79349c2b1 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.158278 Aug 29 20:33:36.100466 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 416/813] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:35 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:36.104765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:36.105369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:36.110994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.111480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.111921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.112637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.113812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.114254 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.177739 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:36.185264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-28792da6-2840-4c85-a4ee-da13ab91cef4 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1293 microversion: 2.1 time: 0.083852 Aug 29 20:33:36.185838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 417/814] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:36 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:36.215025 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5a25776c-5d41-4df8-8e5f-1ebb0d83b8ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030535 Aug 29 20:33:36.221099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 398/815] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:33:35 2022] POST /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:36.322766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "name": "network-vif-plugged", "status": "completed", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:36.332629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.333111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.333540 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.345384 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] Creating event network-vif-plugged:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:33:36.350879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-080794f9-1574-42e6-a7c7-25935ceb8389 req-31781451-25d0-4925-acdb-27b46f20ad48 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Aug 29 20:33:36.351458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 418/816] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:37.123083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:37.134700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:37.134700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.134700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.134700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.135108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.135108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.135108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.207485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:37.208452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:37.215561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.220650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.220650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.220650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.220650 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.221055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.283948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:37.287547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:37.292083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9a9fd694-ac15-4fc6-afb5-14a98602abcf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1301 microversion: 2.1 time: 0.089363 Aug 29 20:33:37.292960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 419/817] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:37 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:37.308208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8bcfb6b1-d144-4a15-8c63-064fb82f0f40 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.189770 Aug 29 20:33:37.308964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 399/818] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:37 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:38.316698 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:38.317823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:38.324100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.325002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.325655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.326591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.327299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.327936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.333449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:38.334961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:38.341928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.342437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.342953 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.343991 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.346584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.347031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.494001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:38.498158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:38.505883 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5ca798ec-6ef0-46ae-b5f9-52322ae35941 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1574 microversion: 2.1 time: 0.179107 Aug 29 20:33:38.506056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b0543e87-78dc-4345-a5cb-282e8cd553c1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.193998 Aug 29 20:33:38.506457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 400/819] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:38 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:38.508351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 420/820] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:38 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:39.432884 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a", "tag": "2b462b58-a519-4754-ba5f-1e2675987f28"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:39.462285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.462780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.463226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.482227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] Creating event network-changed:2b462b58-a519-4754-ba5f-1e2675987f28 for instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a on hv-cinder-85200 Aug 29 20:33:39.489895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-35708fd4-1bf8-4d78-a21b-acfc2f23fec4 req-f448d65e-dadd-4047-ad87-e9f4ecd166f1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062996 Aug 29 20:33:39.490732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 401/821] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:39.528482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:39.529712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:39.537838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.538337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.538778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.539721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:39.539872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.540280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.540710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.540816 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:39.547127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.547611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.548047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.548766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.549217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.549638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.685448 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:39.693708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0cfe897c-b29e-4cda-9bcf-daa3095727c4 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1561 microversion: 2.1 time: 0.170477 Aug 29 20:33:39.694288 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 421/822] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:39 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:39.766046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:39.774430 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-05e6ab0b-fdda-4a49-8cfa-44bf54baa7d2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.239536 Aug 29 20:33:39.775008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 402/823] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:39 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:40.796142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:40.796703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:40.803801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.804322 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.804765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.805475 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.805932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.806356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.937524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:40.945793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c95fd095-89b7-412d-a6d1-51da9c452a70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.153947 Aug 29 20:33:40.946404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 422/824] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:40 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:41.967259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:41.967866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:41.974373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:41.974857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:41.975291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:41.975979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:41.976462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:41.976889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.102964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:42.110578 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-12411cff-9f9c-43c1-8d23-9161c1a57efd tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.147190 Aug 29 20:33:42.111130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 403/825] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:41 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:43.132491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:43.133018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:43.139852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.145386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.145386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.145386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.145386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.145790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.273800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:43.281421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3cc9d476-e287-44ee-8054-343c1305117e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.153386 Aug 29 20:33:43.282007 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 423/826] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:43 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:44.302997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.303609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.306043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.306716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=10 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.311465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.311947 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.312416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.313109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.313560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.314143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.509471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a", "name": "network-vif-plugged", "status": "completed", "tag": "2b462b58-a519-4754-ba5f-1e2675987f28"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:44.520848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.521425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.521925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.535407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] Creating event network-vif-plugged:2b462b58-a519-4754-ba5f-1e2675987f28 for instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a on hv-cinder-85200 Aug 29 20:33:44.541099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-9962e96e-bf9a-45e1-8825-287ed47583b5 req-f0b9c46c-1667-4cae-8125-e17dbcd450d8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036139 Aug 29 20:33:44.541698 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 424/827] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:44.703872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:44.712053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c1c2f0fe-348a-4af4-8997-42e2d3da74b0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.413471 Aug 29 20:33:44.712652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 404/828] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:44.877971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.880935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.887134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.887623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.888066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.888924 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.889418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.889844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.914867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=100 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.921752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8d1d2e3a-cad3-4d2b-a668-39315bc5877f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Aug 29 20:33:44.922316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 425/829] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:44.933401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.933940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.945636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.945636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.945636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.945636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.946009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.946009 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.946975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:44.972705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8b237f36-d2cd-4598-9905-11147e9e4dba tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44" status: 200 len: 194 microversion: 2.1 time: 0.043002 Aug 29 20:33:44.973290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 405/830] 10.222.0.85 () {58 vars in 1413 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:45.733280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:45.733894 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:45.735676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:45.742015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.742500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.742936 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.743625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.744105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.744558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.876352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:45.884498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7d73b3b6-034f-4ae4-a4c1-3b71049ea2f6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1367 microversion: 2.1 time: 0.155423 Aug 29 20:33:45.885072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 426/831] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:45 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:46.906282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:46.908205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:46.913806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.914286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.914722 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.915418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.915981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.916444 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.944435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af837da2-ab2f-47df-8419-50582689a196"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:46.947397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:46.953770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.954260 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.954700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.955491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.955957 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.956587 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.055534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:47.063779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-72624b51-e0c9-4f88-87cf-c018d0449944 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1557 microversion: 2.1 time: 0.161835 Aug 29 20:33:47.064410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 406/832] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:46 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:47.085403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:47.085897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:47.093144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.093633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.094075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.094761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.095215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.095637 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.172159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ca851b2e-1cf4-4ec9-be40-de172fa30bd8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091228 Aug 29 20:33:47.172788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 407/833] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:33:47 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:47.414679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:47.415318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:47.421370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.421890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.422331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.423021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.423482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.423905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.447809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8dca6212-e72f-4661-b341-01a9766683a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/ips" status: 200 len: 152 microversion: 2.20 time: 0.273888 Aug 29 20:33:47.448615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 408/834] 10.222.0.85 () {60 vars in 1289 bytes} [Mon Aug 29 20:33:47 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/ips => generated 152 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:33:48.055039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-efb9aee0-e049-4c61-9cf7-85d7ca035f6e tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "POST /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114735 Aug 29 20:33:48.061603 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 427/835] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:33:46 2022] POST /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 194 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:48.237404 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a", "tag": "2b462b58-a519-4754-ba5f-1e2675987f28"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:48.242658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:48.248274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.248753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.249179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.260994 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] Creating event network-changed:2b462b58-a519-4754-ba5f-1e2675987f28 for instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a on hv-cinder-85200 Aug 29 20:33:48.265938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-67068dad-11f9-4897-ac6e-c3c50825bf30 req-50134bc4-55bf-4cb2-a590-6c799eee2fbe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Aug 29 20:33:48.266609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 409/836] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:50.442566 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:50.443141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:50.449422 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.449905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.450351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.451030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.451482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.451906 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.475208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'flavor' on Instance uuid 91b133b3-0c87-4fce-837f-858cbc6843dc {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:50.933948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c61e7d27-1dce-4c92-a984-e16248a8510d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/action" status: 202 len: 0 microversion: 2.20 time: 0.496577 Aug 29 20:33:50.934539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 428/837] 10.222.0.85 () {62 vars in 1319 bytes} [Mon Aug 29 20:33:50 2022] POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:33:50.943198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:50.943821 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:50.951429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.951907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.952380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.953078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.953523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.953951 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:51.096304 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.105650 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.107097 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.108316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-67bb19cb-7ac6-4bdd-af1e-f685172e8272 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.169230 Aug 29 20:33:51.108900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 410/838] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:50 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:52.131230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:52.131905 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:52.138199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.138665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.139100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.139787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.140269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.140702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.271381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.279684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.281171 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.282321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c47250c4-13bf-4375-9633-15d1a79c7992 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.155900 Aug 29 20:33:52.282880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 429/839] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:52 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:53.306307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:53.306941 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:53.313321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.313802 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.314240 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:53.314926 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.315378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.316437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:53.446424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:53.455944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:53.457425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:53.458610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e5f994e0-32dc-4427-93e3-55e24ded5fd5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.156343 Aug 29 20:33:53.459170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 411/840] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:53 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:54.481932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:54.482542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:54.485362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:54.489634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.490114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.490553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.491231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.491681 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.492103 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.621250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:54.629775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:54.631248 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:54.632424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-44894be8-ebb1-4281-ac1d-9a18737bb62a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.154323 Aug 29 20:33:54.632979 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 430/841] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:54 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:55.655441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:55.656049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:55.663144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:55.663621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:55.664054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:55.664776 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:55.665225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:55.665652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:55.795789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:55.804780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:55.806222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:55.807372 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d78e8c24-e239-44c8-8c74-f6e780feb4ad tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.155791 Aug 29 20:33:55.807925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 412/842] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:55 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:56.633794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.635984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.642471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.644461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.644461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.644461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.644767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.645023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.675723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9604a7ec-86ec-4ead-b498-9e221ae608e5 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045124 Aug 29 20:33:56.678882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 431/843] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:56.823133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.823654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.829824 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.830168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.839535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.839681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.839681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.839681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.839681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.840042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.840135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.840135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.840135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.840135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.840508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.840508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.863035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-624b88ca-1614-455a-9553-435343c4d6c9 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44" status: 200 len: 194 microversion: 2.1 time: 0.043442 Aug 29 20:33:56.863993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 413/844] 10.222.0.85 () {58 vars in 1413 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:56.873817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.877618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.880830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.881320 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.881790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.882485 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.882932 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.883355 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.970013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'services' on Instance uuid c94058bc-c764-424c-9f75-d2f3dc7ac8fe {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:56.975295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:56.983799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:56.985468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:56.986625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-41570e33-99ec-4882-987a-3415260a3919 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.160807 Aug 29 20:33:56.987183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 432/845] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:33:57.260043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9e40fd28-cb9e-46af-9d7a-9ea929bd990b tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44" status: 202 len: 0 microversion: 2.1 time: 0.389719 Aug 29 20:33:57.260733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 414/846] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:33:56 2022] DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/2f6285a9-cd1a-4e73-b8b9-9dea3c623a44 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:33:58.010161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:58.010789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:58.017172 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:58.017653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:58.018087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:58.020195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:58.020195 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:58.020382 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:58.146799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:58.155145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:58.156691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:58.157847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f4ea8f70-f779-4fdd-9c4e-1fae79f25507 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.151645 Aug 29 20:33:58.158404 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 433/847] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:58 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:59.182659 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:59.183353 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:59.190010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.191498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.192073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.192820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.193286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.193711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.321294 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:59.329361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:59.330796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:59.331974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d5ea7f2d-40d7-405c-97bf-e85c95a319d7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.153719 Aug 29 20:33:59.332560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 415/848] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:33:59 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:33:59.444516 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:59.445000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:59.451233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.451714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.452152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.452854 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.453305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.453727 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.481978 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b66ab640-b320-465f-a0f4-4a35fa0ea475 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/af837da2-ab2f-47df-8419-50582689a196" status: 200 len: 194 microversion: 2.1 time: 0.041384 Aug 29 20:33:59.482553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 434/849] 10.222.0.85 () {58 vars in 1413 bytes} [Mon Aug 29 20:33:59 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/af837da2-ab2f-47df-8419-50582689a196 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:59.493636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:59.494129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:59.500089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.500602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.501042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.501728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:59.502187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:59.502616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.581820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'services' on Instance uuid c94058bc-c764-424c-9f75-d2f3dc7ac8fe {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:59.843551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-92fddea9-0979-4d86-9f05-5722d6d872b0 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/af837da2-ab2f-47df-8419-50582689a196" status: 202 len: 0 microversion: 2.1 time: 0.353599 Aug 29 20:33:59.844961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 416/850] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:33:59 2022] DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments/af837da2-ab2f-47df-8419-50582689a196 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:34:00.354236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:00.354790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:00.360795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:00.361282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:00.361718 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:00.362444 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:00.362900 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:00.363327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:00.495702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:00.505745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:00.507340 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:00.508815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3679c131-e7db-4e7c-9676-364565670ab2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.158537 Aug 29 20:34:00.509620 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 435/851] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:00 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:01.533499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:01.534182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:01.540933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:01.541408 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:01.541837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:01.542528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:01.542973 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:01.543450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:01.671836 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:01.680559 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:01.682016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:01.683154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f513045f-2d32-4466-a4cb-013b61882edb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.154593 Aug 29 20:34:01.683722 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 417/852] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:01 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:02.067358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.069552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.075973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.076495 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.076925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.077598 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.078041 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.078455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.109344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b9d49742-67c0-48ac-85b8-af7e1c1496d7 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045910 Aug 29 20:34:02.109882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 436/853] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:34:02 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:34:02.219306 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.221503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.228017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.228539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.228980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.229671 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.230123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.230551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.258870 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b4cd0b6d-131e-4745-99ed-96cef19c9418 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043134 Aug 29 20:34:02.259420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 418/854] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:34:02 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:34:02.319733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.320246 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.326084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.326562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.326995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.327673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.328150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.328595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.353975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:34:02.500499 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:02.704927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.705536 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.712502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.712980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.713445 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.714115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.714560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.714974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.760794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b5b9df6e-308c-4961-85f4-ddd22b0c6e6f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 204 len: 0 microversion: 2.1 time: 0.444376 Aug 29 20:34:02.761363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 437/855] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:34:02 2022] DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:34:02.770611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.771294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.777520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.778001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.778438 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.779143 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.779586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.780003 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.851151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:02.859412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:02.860890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:02.862530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f6e909a3-fc16-47db-ae6f-2c632fa74539 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.161061 Aug 29 20:34:02.862634 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 419/856] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:02 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:02.915197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:02.923094 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-283fe7e0-fc71-4c9d-926d-adc474a8352f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1671 microversion: 2.1 time: 0.157178 Aug 29 20:34:02.923680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 438/857] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:02 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:03.899094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:03.899094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:03.899094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:03.899094 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:03.900047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:03.900047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:03.900047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:03.900047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:03.945578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:03.946286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:03.953259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:03.953815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:03.954323 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:03.955114 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:03.955657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:03.956152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:04.028990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:04.037997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:04.039465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:04.040647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-96501051-36ff-4507-b212-bd869685302a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.158024 Aug 29 20:34:04.041207 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 420/858] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:03 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:04.086052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:04.093781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-69e281a5-31bb-42b8-be3e-7bb3a71f89eb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1671 microversion: 2.1 time: 0.152115 Aug 29 20:34:04.095809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 439/859] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:03 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:05.064464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:05.065763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:05.072787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.073276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.073716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.074413 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.074886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.075311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.115405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:05.116014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:05.123687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.123892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.124330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.125031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.125487 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.125912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.211596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:05.215442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:05.220641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:05.223308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:05.223983 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-88115216-9736-4a36-ba6b-1ed8e31aabe3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.163358 Aug 29 20:34:05.224593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 421/860] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:05 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:05.264978 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:05.273134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4a34096e-35f8-4ac9-9674-e0d2d6b7781f tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1671 microversion: 2.1 time: 0.162003 Aug 29 20:34:05.273704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 440/861] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:05 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:06.248137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:06.248768 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:06.256465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.257008 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.257421 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.258214 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.258689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.259129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.294730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:06.295514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:06.302657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.303145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.303580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.304306 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.304795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.305243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.366951 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:06.374665 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-50e58090-ca23-48c5-84dc-b69400a897cb tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1603 microversion: 2.1 time: 0.083736 Aug 29 20:34:06.375229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 441/862] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:06 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1603 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:06.475863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:06.487205 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:06.490419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:06.493663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b688cb87-878a-475d-8d47-4decd44cff8d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.248394 Aug 29 20:34:06.495422 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 422/863] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:06 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:06.508674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94058bc-c764-424c-9f75-d2f3dc7ac8fe", "name": "network-vif-deleted", "tag": "1755fcc0-0555-40d4-84c0-a6d6b62d20c8"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:06.520945 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.521425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.522023 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.534370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] Creating event network-vif-deleted:1755fcc0-0555-40d4-84c0-a6d6b62d20c8 for instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe on hv-cinder-85200 Aug 29 20:34:06.541336 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-1fac9a93-16fb-4527-b65e-96d7cae0cf7a req-bd774d3a-4d8a-417b-8d9c-9632c6f66e94 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036001 Aug 29 20:34:06.541947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 442/864] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:07.397103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:07.398060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:07.404621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.405105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.405541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.406289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.406743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.407167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.439345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.439909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.440407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.440976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lazy-loading 'fault' on Instance uuid c94058bc-c764-424c-9f75-d2f3dc7ac8fe {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:34:07.482605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4b05a527e14d2599e03077c6c5f96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adb6c50ed6c4fa5beebf037da1e73e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:07.491268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1ab2b373-1ede-42c2-b4ee-aee2367166ab tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 200 len: 1326 microversion: 2.1 time: 0.098558 Aug 29 20:34:07.491950 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 423/865] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:07 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:07.518436 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:07.519138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:07.526339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.526831 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.527269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.528049 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.528585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.531862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.667951 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:07.676094 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:07.677551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:07.678749 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-36d99e85-5d0d-450c-bc51-c14f70b2a7c8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.164591 Aug 29 20:34:07.679346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 443/866] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:07 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:08.516789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:08.517397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:08.524013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.524616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.525051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.525730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.526182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.526601 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.540940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe HTTP/1.1 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:34:08.542826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:08.544540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'c94058bc-c764-424c-9f75-d2f3dc7ac8fe'} Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:08.545528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:08.547124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:08.548530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:08.548530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-feb01ec8-dc4c-4924-ad26-b3cd90e52412 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 404 len: 111 microversion: 2.1 time: 0.031288 Aug 29 20:34:08.548530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 424/867] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:08 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:08.553892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fd6805ef-b7a1-4279-8273-9e0eaae4f83c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '.version_select at 0x7f8987602790>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:08.629572 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fd6805ef-b7a1-4279-8273-9e0eaae4f83c tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494046821" status: 202 len: 0 microversion: 2.1 time: 0.080336 Aug 29 20:34:08.630322 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 444/868] 10.222.0.85 () {58 vars in 1218 bytes} [Mon Aug 29 20:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494046821 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:34:08.703568 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:08.704223 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:08.711989 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.713006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.713468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.714373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.714834 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.715296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.846811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:08.855112 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:08.856827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:08.858211 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a2d5e574-c4f7-45b2-b7ec-effd99e47351 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.159313 Aug 29 20:34:08.858777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 425/869] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:08 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:09.882733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:09.883327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:09.890193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.890670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.891095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:09.891787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.892257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.892676 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:10.020220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:10.031265 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:10.032762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:10.033921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9566824e-35f3-49d1-af14-6cd9487730a2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.156857 Aug 29 20:34:10.034984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 445/870] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:09 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:11.056917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:11.058196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:11.065006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.067031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.067031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.067031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.067031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.067438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.194770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:11.203646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:11.205311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:11.206997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c7ec13c0-0384-4fcb-bd94-0c9482963b54 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.153792 Aug 29 20:34:11.207556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 426/871] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:11 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:12.097692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:12.098198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:12.104613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.107576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.107576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.107576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.107576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.107949 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.120757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe HTTP/1.1 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:34:12.122390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.123994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'c94058bc-c764-424c-9f75-d2f3dc7ac8fe'} Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:12.124822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.126055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.127255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:12.127255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-eff6ee75-2259-4c1f-bd36-94f50eb73b2d tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 404 len: 111 microversion: 2.1 time: 0.030712 Aug 29 20:34:12.127255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 446/872] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:34:12 2022] DELETE /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:12.133024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:12.133687 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: c94058bc-c764-424c-9f75-d2f3dc7ac8fe] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:12.140396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.140888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.141318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.141992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.142436 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.142849 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.158116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe HTTP/1.1 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:34:12.159684 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.161379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'c94058bc-c764-424c-9f75-d2f3dc7ac8fe'} Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:12.162431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. Aug 29 20:34:12.163914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:34:12.165338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance c94058bc-c764-424c-9f75-d2f3dc7ac8fe could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:12.165338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d25745fd-9f24-4611-b29a-d988eec26bd3 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe" status: 404 len: 111 microversion: 2.1 time: 0.032023 Aug 29 20:34:12.165338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 427/873] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:12 2022] GET /compute/v2.1/servers/c94058bc-c764-424c-9f75-d2f3dc7ac8fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:12.229113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:12.229810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:12.235605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.236093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.236634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.237319 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.237774 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.238197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.369299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:12.380919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:12.382400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:12.383611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c4b2dc49-031a-445f-8176-e36c1b0062a3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1745 microversion: 2.20 time: 0.158357 Aug 29 20:34:12.384208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 447/874] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:12 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:13.407618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:13.408252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:13.415324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.415804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.416299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.416990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.417448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.417875 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.459811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:13.461166 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:13.467696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.468203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.468640 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.469331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.469785 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.470205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.484940 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 HTTP/1.1 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:34:13.489950 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.491578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '01cc3eff-660a-4cdb-93ec-9c5083607486'} Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:13.492432 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.493891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.495435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:13.495435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6676af57-16ff-40b2-8862-885bd4d762f6 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 404 len: 111 microversion: 2.1 time: 0.032806 Aug 29 20:34:13.495435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 448/875] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:34:13 2022] DELETE /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:34:13.496638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:13.497117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] [instance: 01cc3eff-660a-4cdb-93ec-9c5083607486] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:13.503002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.503486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.503923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.504639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.505090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.505513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.519642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] HTTP exception thrown: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Request method failure captured: Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 HTTP/1.1 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSEeXPpKVwF885bw-Im0b42_uCgvj7HZkg3thVE_wYdnxoO964wpdGRUMNBPhBI2SBGy9AT4CXrk2QjcxB0WlLoq3S0_tSfDCtQzC6fqRyKS_3t2qsxwwtJGfy5UTmA4rjrGi5KdTU2cplVpA1561O-5BJ6eUrPok7_aKof3NPenpsw Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:34:13.521269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6adb6c50ed6c4fa5beebf037da1e73e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6adb6c50ed6c4fa5beebf037da1e73e7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 6adb6c50ed6c4fa5beebf037da1e73e7 Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928353768 Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 3f4b05a527e14d2599e03077c6c5f96f Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeTestJSON-1928353768-project Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.523328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '01cc3eff-660a-4cdb-93ec-9c5083607486'} Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:13.524429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. Aug 29 20:34:13.527072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:34:13.528448 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] Returning 404 to user: Instance 01cc3eff-660a-4cdb-93ec-9c5083607486 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:13.528448 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9e3e48d3-c54b-4360-a6b6-95b769b31f23 tempest-AttachVolumeTestJSON-1928353768 tempest-AttachVolumeTestJSON-1928353768-project] 10.222.0.85 "GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486" status: 404 len: 111 microversion: 2.1 time: 0.030293 Aug 29 20:34:13.529576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 449/876] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:13 2022] GET /compute/v2.1/servers/01cc3eff-660a-4cdb-93ec-9c5083607486 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:34:13.562465 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:13.570831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:13.572302 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:13.573474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-440f85d4-eb56-4439-bb83-a828166b14cb tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1745 microversion: 2.20 time: 0.169888 Aug 29 20:34:13.574220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 428/877] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:13 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:14.598752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:14.599365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:14.625349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.625349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.625349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.625349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.625863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.625863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.762790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:14.770030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:14.771479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:14.772919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-176b6ec1-581a-41eb-87d9-bee2dadb0cd1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1745 microversion: 2.20 time: 0.178863 Aug 29 20:34:14.773530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 450/878] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:14 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:15.797175 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:15.798544 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:15.807745 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.808790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.809414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.811021 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.811774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.812693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.977624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:15.990638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:15.992101 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:15.993378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-db9540da-b775-4107-b866-0bd40f1cf54e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.201782 Aug 29 20:34:16.008194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 429/879] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:15 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:16.606656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "name": "network-vif-plugged", "status": "completed", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:16.628196 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.629637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.630441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.650680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] Creating event network-vif-plugged:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:34:16.656445 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-09dd97fd-f788-4c5c-88fb-b2d405b15227 req-c61b0d0f-eee0-405e-9efa-15e4f64ebd39 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052973 Aug 29 20:34:16.657845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 451/880] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:17.018019 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:17.019429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:17.030565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.032772 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.036024 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:17.037060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.037716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.039938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:17.609003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:17.620664 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:17.626398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:17.628373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b11123aa-6a3a-493f-9335-d004f608ede5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.613931 Aug 29 20:34:17.631792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 430/881] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:17 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:18.655219 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:18.655908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:18.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:18.669605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:18.670581 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:18.671870 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:18.673218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:18.674053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:18.850471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:18.861401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:18.867628 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:18.870011 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-85399718-a051-4e97-9f2f-435f4693cf2d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.218912 Aug 29 20:34:18.870721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 452/882] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:18 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:19.893187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:19.893723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:19.900833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.901315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.901748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.902424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.902871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.903295 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:20.037004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:20.045972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:20.047507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:20.048809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ac3c9758-218a-45f6-ac62-c812869f1395 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.159620 Aug 29 20:34:20.063957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 431/883] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:19 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:21.072054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:21.072701 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:21.079173 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.079838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.080518 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.084010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.084553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.085009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.286629 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:21.296646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:21.298884 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:21.300908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-47038514-32ff-4eea-94db-97aa56a699ab tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.232941 Aug 29 20:34:21.301771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 453/884] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:21 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:22.327611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:22.328522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:22.351440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=48 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:22.353305 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:22.354062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:22.354787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:22.357225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:22.357891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:22.360588 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:22.410929 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-555952d8-7d4e-4feb-aa41-1163ebf54b8e tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f8987591940>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:22.466920 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-555952d8-7d4e-4feb-aa41-1163ebf54b8e tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/15da267d-1a43-42bd-817b-95dec428ceca" status: 200 len: 351 microversion: 2.1 time: 0.060978 Aug 29 20:34:22.467591 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 454/885] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:34:22 2022] GET /compute/v2.1/os-volumes/15da267d-1a43-42bd-817b-95dec428ceca => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:34:22.587546 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:22.602278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:22.605103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:22.607435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d5b18508-ea87-4de5-a52b-81d48ec4252f tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.284011 Aug 29 20:34:22.621278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 432/886] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:22 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:23.633299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:23.634121 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:23.643075 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:23.644318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:23.645026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:23.646000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:23.646810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:23.647683 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:23.797004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:23.806139 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:23.807585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:23.808904 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-637401c4-8769-47e6-9026-bcab76c07359 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.179422 Aug 29 20:34:23.825333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 455/887] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:23 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:24.831763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:24.833253 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:24.840874 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.841643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.842090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.858280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.858280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.858280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:25.311789 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:25.321027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:25.322790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:25.324137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8ba2015f-2f65-4dc2-aace-b42fa6ac5de3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.496337 Aug 29 20:34:25.324897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 433/888] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:24 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:26.005524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-452f47e2-a75f-4a54-831a-2d437687f889 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f8987591040>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:26.059058 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-452f47e2-a75f-4a54-831a-2d437687f889 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bc6b7cdf-9dc0-4817-b56c-7150e17f6fcf" status: 200 len: 351 microversion: 2.1 time: 0.057461 Aug 29 20:34:26.059692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 456/889] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:34:26 2022] GET /compute/v2.1/os-volumes/bc6b7cdf-9dc0-4817-b56c-7150e17f6fcf => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:26.468603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:26.468603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:26.468603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:26.468603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:26.470182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:26.470182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:26.470182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:26.470182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:26.498608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:26.507925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:26.509475 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:26.510734 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a6b4f6fa-faa6-43a7-ae39-4fc696ae48de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.167936 Aug 29 20:34:26.511384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 434/890] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:26 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:27.535784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:27.536538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:27.539180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:27.544738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:27.545585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:27.546256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:27.547174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:27.547713 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:27.548243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:27.691955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:27.702353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:27.704250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:27.705670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5726d82d-b953-4b06-8729-ec95b985aeb1 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.174529 Aug 29 20:34:27.706881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 457/891] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:27 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:28.257459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-bd592089-3143-4273-a9ae-45972567a1e6 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f89875c8a60>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.305618 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-bd592089-3143-4273-a9ae-45972567a1e6 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bca59e23-f809-4bdd-b88f-7ac45f13d765" status: 200 len: 350 microversion: 2.1 time: 0.052551 Aug 29 20:34:28.308227 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 435/892] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes/bca59e23-f809-4bdd-b88f-7ac45f13d765 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:28.321218 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f9799fd-f52c-43fa-948c-41ac29f8028e tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f8987591790>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.402407 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f9799fd-f52c-43fa-948c-41ac29f8028e tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085188 Aug 29 20:34:28.403031 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 458/893] 10.222.0.85 () {58 vars in 1134 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:28.416846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-85e67a26-e296-45e0-8550-c7f3a5dbccd2 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f898756c430>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.498511 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-85e67a26-e296-45e0-8550-c7f3a5dbccd2 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085349 Aug 29 20:34:28.499079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 436/894] 10.222.0.85 () {58 vars in 1149 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:28.511793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8242b2d4-8012-4ae7-a0aa-0ca1e492a0d9 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f89875d7160>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.779101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8242b2d4-8012-4ae7-a0aa-0ca1e492a0d9 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110885 Aug 29 20:34:28.779101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 459/895] 10.222.0.85 () {58 vars in 1134 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:28.780468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a0e2e984-b35e-4e56-a4c9-c26aa358a18a tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f89875bf310>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.780468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a0e2e984-b35e-4e56-a4c9-c26aa358a18a tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092500 Aug 29 20:34:28.780468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 437/896] 10.222.0.85 () {58 vars in 1167 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:34:28.781550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.781550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:28.782172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2a736efb-6d39-4468-b638-8e16bf547710 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f898756c940>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.782261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:28.782261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:28.782261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:28.782261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:28.783098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:28.783098 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:28.830325 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2a736efb-6d39-4468-b638-8e16bf547710 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098547 Aug 29 20:34:28.830986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 438/897] 10.222.0.85 () {58 vars in 1170 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:34:28.850238 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-271c007d-b1ab-46fa-9041-c5204cca9200 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f89877408b0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.901927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:28.911903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:28.913538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:28.915691 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3fadc778-39cb-4fdd-89ab-d22380ddc6e8 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1740 microversion: 2.20 time: 0.188516 Aug 29 20:34:28.916468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 460/898] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:28.937985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-271c007d-b1ab-46fa-9041-c5204cca9200 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092224 Aug 29 20:34:28.938727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 439/899] 10.222.0.85 () {58 vars in 1155 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:28.951331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6a35da32-7931-44f8-8fa7-2c1e529db6fa tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f8987591160>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:29.042656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6a35da32-7931-44f8-8fa7-2c1e529db6fa tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095002 Aug 29 20:34:29.043257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 461/900] 10.222.0.85 () {58 vars in 1188 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:29.056476 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9d83d21a-1a9b-47c0-a29a-20fe5be47846 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] Calling method '.version_select at 0x7f8987578a60>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:29.145460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9d83d21a-1a9b-47c0-a29a-20fe5be47846 tempest-VolumesTestJSON-248970544 tempest-VolumesTestJSON-248970544-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089135 Aug 29 20:34:29.145460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 440/901] 10.222.0.85 () {58 vars in 1155 bytes} [Mon Aug 29 20:34:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:29.941502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:29.942261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:29.949557 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:29.950252 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:29.950875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:29.951956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:29.952769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:29.953460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:30.098460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:30.106511 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:30.107961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:30.109147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e6576ebd-f809-4c86-9306-fb6e6d500926 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1722 microversion: 2.20 time: 0.173148 Aug 29 20:34:30.109704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 462/902] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:29 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:31.133031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:31.133729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:31.142945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:31.144198 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:31.149630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:31.149630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:31.149630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:31.149630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:31.278131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:31.286415 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:31.287878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:31.289069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-312d175f-2002-408f-aceb-a972cd5cb01a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1722 microversion: 2.20 time: 0.160733 Aug 29 20:34:31.289626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 441/903] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:31 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:32.311962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:32.312597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:32.319570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.320049 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.320517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.321200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.321705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.322125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.337225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.457187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:32.465488 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:32.466915 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:32.468065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e7386501-408e-4be0-a374-5e2b1425ed87 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1725 microversion: 2.20 time: 0.160020 Aug 29 20:34:32.468654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 463/904] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:32 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:32.496357 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50e9e7f9-ada0-429c-bbc3-214406531d24"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:32.499130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:32.507154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.507625 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.508051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.508815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.509292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.509759 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.702275 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "name": "network-vif-unplugged", "status": "completed", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:32.714627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.714627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.714627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.889155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.compute.server_external_events [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] Unable to find a host for instance 91b133b3-0c87-4fce-837f-858cbc6843dc. Dropping event network-vif-unplugged {{(pid=121467) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 20:34:32.890095 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-1ac9a144-dfef-4fb1-a971-66ce6130c121 req-0cdf0e82-b0af-47ea-8bbc-4eafa404226a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.191665 Aug 29 20:34:32.890669 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 464/905] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 193 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 20:34:32.895700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:32.896189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:32.902313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.902789 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.903231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.903924 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.904421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.907142 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.935186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4522d62f-6005-4ca7-a0a7-1814c9290729 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/ips" status: 200 len: 150 microversion: 2.1 time: 0.040082 Aug 29 20:34:32.935186 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 465/906] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:34:32 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:33.881030 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:34.009480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f04e5272-e500-4a0e-a415-e354c5e4e28e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.517447 Aug 29 20:34:34.010288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 442/907] 10.222.0.85 () {62 vars in 1364 bytes} [Mon Aug 29 20:34:32 2022] POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments => generated 188 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:34:34.148733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:34.149306 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:34.155479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:34.156126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:34.156494 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:34.157169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:34.157616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:34.158030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:34.969751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-46329fd6-02ec-415e-9eba-6adaa69a2aef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments/50e9e7f9-ada0-429c-bbc3-214406531d24" status: 202 len: 0 microversion: 2.20 time: 0.825272 Aug 29 20:34:34.974538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 466/908] 10.222.0.85 () {60 vars in 1457 bytes} [Mon Aug 29 20:34:34 2022] DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments/50e9e7f9-ada0-429c-bbc3-214406531d24 => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:34:35.003129 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58cd4108-1c9d-43a8-b53b-971f98ff60dd"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:35.006414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:35.014619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.015110 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.015547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.016514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.020194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.020707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.042417 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:35.043154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:35.049988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.050477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.051198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.051895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.052391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.053005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.196980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121467) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:34:35.714304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0d36f734-5457-421d-bc5e-c076c596f2f2 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/action" status: 202 len: 0 microversion: 2.20 time: 0.675709 Aug 29 20:34:35.715125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 467/909] 10.222.0.85 () {62 vars in 1319 bytes} [Mon Aug 29 20:34:35 2022] POST /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:34:35.723157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:35.723626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:35.729769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.734795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.734795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.734795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.734795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.735224 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.866181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:35.874520 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:35.876042 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:35.877826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-40507f13-acfe-4a15-8e77-84bc8d0a500e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1673 microversion: 2.20 time: 0.158184 Aug 29 20:34:35.878493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 468/910] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:35 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:36.411616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-efe93a22-94d3-4286-a5ec-a936b38371d3 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.408717 Aug 29 20:34:36.411616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 443/911] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:34:34 2022] POST /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments => generated 194 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:36.901787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:36.902403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:36.908583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:36.909074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:36.909510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:36.910211 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:36.910671 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:36.911099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:37.045273 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:37.054215 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:37.055668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:37.056861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ff9f5b45-68a2-4b98-ae69-29328d84edf7 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1673 microversion: 2.20 time: 0.159321 Aug 29 20:34:37.057420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 469/912] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:36 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:38.083277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:38.083277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:38.087322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:38.087881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:38.088377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:38.089089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:38.089550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:38.090168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:38.224535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:38.232632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:38.234072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:38.235222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5327e7a7-ce02-4215-9280-1525e79a904e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.160135 Aug 29 20:34:38.235787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 444/913] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:38 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:39.259623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:39.260257 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:39.266714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.267200 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.267634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.268863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.269317 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.269787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.407598 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:39.416324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:39.417760 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:39.418922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e8dddea-3c14-4491-97e3-a688a0650868 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.163365 Aug 29 20:34:39.419474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 470/914] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:39 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:40.441360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:40.442853 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:40.450522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:40.451114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:40.451610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:40.452633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:40.453290 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:40.453785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:40.600630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:40.619658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:40.621208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:40.622388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7bbe4208-e1d6-4330-9554-2ee10c368a1a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.185279 Aug 29 20:34:40.623260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 445/915] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:40 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:41.650460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:41.652125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:41.661358 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:41.662109 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:41.663025 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:41.663892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:41.664606 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:41.665193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:41.837890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:41.847022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:41.848668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:41.850334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-adaa3b10-3c6e-4464-8f5b-f0e1bf5bfd96 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.205613 Aug 29 20:34:41.851668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 471/916] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:41 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:42.874828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:42.876155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:42.884121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.884868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.905810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:42.914962 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.918787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.920194 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:43.101345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:43.109956 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:43.111499 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:43.113158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1f524ac8-ffbc-40ae-8e5e-d4621147b4bd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.243094 Aug 29 20:34:43.113891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 446/917] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:42 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:44.136360 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:44.137068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:44.143992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:44.144522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:44.144961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:44.145775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:44.146232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:44.146663 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:44.309182 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:44.319810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:44.322187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:44.323387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c79ca081-17d9-4143-b28e-1ed5bd8902ed tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.191044 Aug 29 20:34:44.323985 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 472/918] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:44 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:45.349081 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:45.350478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:45.359006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.359786 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:45.360362 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:45.361138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.361754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:45.362252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:45.510911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:45.517182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:45.519177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:45.520394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-46f28b19-2399-49b6-a82c-2982d04c1b51 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.177028 Aug 29 20:34:45.520954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 447/919] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:45 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:46.542943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:46.543737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:46.550585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:46.551349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:46.552055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:46.552800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:46.553261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:46.553690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:46.907227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:46.916458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:46.926374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:46.926374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-64889c40-50c2-4646-af9d-24d481e39df4 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.380249 Aug 29 20:34:46.926374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 473/920] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:46 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:47.961942 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:47.962594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:47.969060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.969585 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.970042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:47.971254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.971731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.972195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:48.104675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:48.113617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:48.115090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:48.116273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-33259685-22bd-453d-b018-a944f4386a18 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.158159 Aug 29 20:34:48.116829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 448/921] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:47 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:49.138775 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:49.139386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:49.146568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.147061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.147764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.148473 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.148928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.149351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.275652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:49.284402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:49.285863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:49.287032 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-206981aa-c458-4d0f-bef3-1b8f403a5bbd tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.152191 Aug 29 20:34:49.287586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 474/922] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:49 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:50.311351 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:50.312078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:50.320233 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.320824 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.321288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:50.322046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.322514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.322999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:50.474665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:50.483042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:50.484508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:50.485665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-151e27fe-7656-4354-a6d5-eb48a8c24459 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.178771 Aug 29 20:34:50.487192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 449/923] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:50 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:51.517002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:51.517002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:51.525060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:51.525954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:51.526575 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:51.527570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:51.528796 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:51.529593 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:51.650808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-83604566-d250-4286-b7da-3545b65a465b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: .version_select at 0x7f89875bf1f0>, body: {"keypair": {"name": "tempest-keypair-451619131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNis0QK6YSd5Zdk+MeQkVcrzHh4egHt7rg1cv+vUArXW2iK6ECm80MXRQZOIgqXyGfFl798rb/b8nlgzAwZnVN7WCGIo47vroW7NJFOGe7po/NijRbZdARzHoljIoJ/+GA=="}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:51.678215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-83604566-d250-4286-b7da-3545b65a465b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:34:51.682391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:51.683073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-83604566-d250-4286-b7da-3545b65a465b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:34:51.692001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:51.693485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:51.694899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-23dceb44-70bb-4b4c-9f50-1acb636f748c tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.186137 Aug 29 20:34:51.695458 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 475/924] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:51 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:51.765128 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-83604566-d250-4286-b7da-3545b65a465b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120899 Aug 29 20:34:51.765699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 450/925] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:34:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:34:52.692980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "name": "network-vif-plugged", "status": "completed", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:52.702837 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.704542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.704542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.714966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] Creating event network-vif-plugged:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:34:52.717835 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:52.719173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:52.720525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-cd430451-722f-482a-b642-8184284242aa req-ee6c7e3c-081c-48cb-a13d-ba964880a484 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Aug 29 20:34:52.721029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:52.721170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 476/926] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:52.726500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.726987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.727427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.728119 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.728615 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.729040 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.887484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:52.898184 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:52.899760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:52.901018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9f82076b-ddfb-4bf5-93e6-0f3809719ff3 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.187022 Aug 29 20:34:52.901889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 451/927] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:52 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:53.927111 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:53.927865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:53.934115 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:53.934613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:53.935055 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:53.935753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:53.936242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:53.936673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.073547 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:54.086087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:54.086087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:54.086087 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-208ec611-cfd5-4c07-b4df-329c058f8b6b tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.163201 Aug 29 20:34:54.086568 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 477/928] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:53 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:54.770858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236004460", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e83db8-f1ae-4fb9-8271-926f248d148a"}], "security_groups": [{"name": "tempest-securitygroup--261295152"}], "key_name": "tempest-keypair-451619131", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:54.879667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] validate_networks() for [('f1e83db8-f1ae-4fb9-8271-926f248d148a', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:34:55.108013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:55.108727 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:55.116019 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.116656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.117155 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.117901 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.118418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.118924 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.123026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:55.254883 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.263564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.265066 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.266005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e5f94c04-b74c-40af-8bd7-4e178a8c9c27 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.161950 Aug 29 20:34:55.266863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 478/929] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:55 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:55.277612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:34:55.278082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:34:55.278633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:34:55.279142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:34:55.279628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:34:55.289226 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.289792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.290262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.290990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.291447 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.291909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.310319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:34:55.314506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:34:55.326993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:34:55.330145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:34:55.465525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-18b15001-acae-4157-9604-96d1f5f855ab tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.699833 Aug 29 20:34:55.466139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 452/930] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:34:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:34:55.477793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-96f20c82-ef32-4323-b827-aed25ca301b7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:55.478398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-96f20c82-ef32-4323-b827-aed25ca301b7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:55.534592 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-96f20c82-ef32-4323-b827-aed25ca301b7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.541605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-96f20c82-ef32-4323-b827-aed25ca301b7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1240 microversion: 2.1 time: 0.067709 Aug 29 20:34:55.542241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 479/931] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:55 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:56.289415 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:56.290054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:56.297222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.297765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.298203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.298893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.299350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.299771 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.435296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:56.444446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:56.445907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:56.447320 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-61614202-bbd2-47ba-8478-7f5fa320d7ef tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1731 microversion: 2.20 time: 0.161872 Aug 29 20:34:56.447898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 453/932] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:56 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:56.563348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:56.563949 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:56.571877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.572403 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.572845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.573533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.573984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.574413 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.636719 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:56.644251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-77de3ef4-0c92-4558-ac9f-d265877ce46e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1244 microversion: 2.1 time: 0.085089 Aug 29 20:34:56.647198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 480/933] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:56 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:57.471551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:57.472181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:57.478621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.479104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.479539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.480260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.480720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.481144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.615727 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.624130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.625660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.627380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f11f28b5-3bc8-4415-aa7a-88fd8c74ad97 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1718 microversion: 2.20 time: 0.159981 Aug 29 20:34:57.627962 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 454/934] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:57 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:57.665534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:57.666147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:57.673107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.673534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.674599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.675294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.675861 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.676342 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.755846 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.764990 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-05a3c9fb-5790-49c8-8278-a4bf66fdf1e8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1292 microversion: 2.1 time: 0.103676 Aug 29 20:34:57.765677 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 481/935] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:57 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:58.787130 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:58.787922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:58.794591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.795201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.795756 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.796590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.797154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.797696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.871368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:58.879731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0bf2246f-f0e4-421c-950d-c0a3b80df66e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1298 microversion: 2.1 time: 0.096451 Aug 29 20:34:58.880329 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 455/936] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:58 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:59.901538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:59.902144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:59.904467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:59.909732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.910278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.910721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.911595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.912125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.912480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.930000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969e255f-8170-47dd-a4ce-ef610d035370", "tag": "3ea8ac51-9524-45e9-84b1-5a510215cfde"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:59.942053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.943066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.943750 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.964123 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] Creating event network-changed:3ea8ac51-9524-45e9-84b1-5a510215cfde for instance 969e255f-8170-47dd-a4ce-ef610d035370 on hv-cinder-85200 Aug 29 20:34:59.969790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-a1c4e9f6-303b-44b4-ba50-15eaee435c76 req-ccdd01b2-95a9-4dca-8dd5-0ded07f85d7a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 Aug 29 20:34:59.970419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 456/937] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:00.062085 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:00.070550 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4aad6634-794f-408a-bee6-0c60b174bd61 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.173454 Aug 29 20:35:00.071138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 482/938] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:59 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:01.092507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:01.093295 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:01.099506 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:01.099993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:01.100461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:01.101150 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:01.101606 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:01.102033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:01.237103 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:01.245007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-88ff5feb-b797-4d9e-980a-d149e05a2bfb tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.157317 Aug 29 20:35:01.248075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 457/939] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:01 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:02.268733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:02.268733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:02.276021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.279549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.279549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.279549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.279549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.279923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.473004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:02.480841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ed4bc7ee-a1aa-4c29-baee-bc10e389f2e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.217799 Aug 29 20:35:02.481414 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 483/940] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:02 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:02.560658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:02.561155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:02.563943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:02.568651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.569137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.569765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.570470 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.570925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.571370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.582226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.582707 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.583117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.595554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] Creating event network-changed:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:35:02.597612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:02.600558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-d6515e05-1d25-4cd7-8dfa-9eba96941a66 req-c936aaea-cd15-41a2-b3bd-4c6a39bd0212 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041274 Aug 29 20:35:02.601184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 484/941] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:02.761338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:02.982847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9eaef0df-0a25-4f74-856b-a36b993044d6 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 204 len: 0 microversion: 2.1 time: 0.425752 Aug 29 20:35:02.987992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 458/942] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:35:02 2022] DELETE /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:35:02.993297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:02.993932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:03.000122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.000724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.001158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.002394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.002837 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.003258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.191579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.199689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b95f8070-8878-4876-ba3c-31171fc9896c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.210540 Aug 29 20:35:03.200255 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 485/943] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:02 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:03.505817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:03.508405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:03.516005 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.516850 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.517331 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.518080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.518707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.519131 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.664453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.672705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b02f6b82-ed96-4259-948c-f4880c79efca tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.173930 Aug 29 20:35:03.673306 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 459/944] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:03 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:04.220722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:04.221324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:04.227894 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.228474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.228866 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.229558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.230146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.230573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.373086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:04.381426 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-00a8ccdb-c865-4561-962b-314d0621433a tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1567 microversion: 2.1 time: 0.164670 Aug 29 20:35:04.382004 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 486/945] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:04 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:04.694788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:04.695904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:04.702886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.703523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.704065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.704895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.705531 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.706590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.903429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:04.912821 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969e255f-8170-47dd-a4ce-ef610d035370", "name": "network-vif-plugged", "status": "completed", "tag": "3ea8ac51-9524-45e9-84b1-5a510215cfde"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:04.928226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.928995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.929564 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.929686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-aa5025a4-ee17-4127-9d90-cb4e4531bae7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.239200 Aug 29 20:35:04.930280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 460/946] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:04 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:04.956586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] Creating event network-vif-plugged:3ea8ac51-9524-45e9-84b1-5a510215cfde for instance 969e255f-8170-47dd-a4ce-ef610d035370 on hv-cinder-85200 Aug 29 20:35:04.969160 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-29cd8893-91b2-4cc7-9d00-dc365b1dd1af req-9225b29a-fd02-45fa-a447-65acfeeba8aa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063068 Aug 29 20:35:04.973327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 487/947] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:05.403340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:05.403964 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:05.406109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:05.406812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=10 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:05.412071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.412804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.413395 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.414275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.415076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.415496 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.521315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:05.530495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-db5928f1-fcf3-4c54-a653-4bbf1fa0063c tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1381 microversion: 2.1 time: 0.130968 Aug 29 20:35:05.540313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 461/948] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:05 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1381 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:05.565117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef448e4-4c7d-4e0b-8542-864ad660beb8", "name": "network-vif-deleted", "tag": "4c60dcc6-8387-499b-a7b2-aefeb0ee1380"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:05.571876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:05.576076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.576600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.577043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.588874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] Creating event network-vif-deleted:4c60dcc6-8387-499b-a7b2-aefeb0ee1380 for instance cef448e4-4c7d-4e0b-8542-864ad660beb8 on hv-cinder-85200 Aug 29 20:35:05.593882 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6580716d-9316-43ad-8250-c690a74b3585 req-fd81f164-fee4-4531-aaa3-0073fa49cf31 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 Aug 29 20:35:05.594843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 488/949] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:05.952759 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:05.953393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:05.961859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.962345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.962779 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.963492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.963944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.964517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.098394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.106139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-80b7f2ea-a8fb-4862-bdf0-f5c685c9cc18 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.157625 Aug 29 20:35:06.106694 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 462/950] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:05 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:06.555654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:06.556443 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:06.563245 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.565154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.565751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.566324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.566795 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.567226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.630751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.638955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3d2c64a8-b356-4a5c-876f-cdbd515e9659 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1218 microversion: 2.1 time: 0.087525 Aug 29 20:35:06.639526 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 489/951] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:06 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:07.126806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:07.127418 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:07.133848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.134388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.134764 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.138651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.138651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.138651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.271073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:07.279696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-aa3954d9-f249-417a-9c4d-f24293ed29d7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1365 microversion: 2.1 time: 0.156554 Aug 29 20:35:07.280345 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 463/952] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:07 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:07.662053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:07.662658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:07.669802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.670484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.671002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.671879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.672383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.672814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.706349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.706839 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.707309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.707761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lazy-loading 'fault' on Instance uuid cef448e4-4c7d-4e0b-8542-864ad660beb8 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:07.751346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d668bfaf71417baac3c4336c33ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28205e89c1441bbb3f1d68ac8893e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:07.760624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b0553040-05fe-4407-a73e-1f6aa071b522 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 200 len: 1223 microversion: 2.1 time: 0.103376 Aug 29 20:35:07.761213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 490/953] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:07 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:08.302601 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.303504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.311316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.311873 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.317679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.317679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.317679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.317679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.445647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.453542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a78f1a6c-520b-4186-9860-4711bfe9c95b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1555 microversion: 2.1 time: 0.156848 Aug 29 20:35:08.455083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 464/954] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:08.474730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.475405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.481397 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.481913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.482351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.483033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.483486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.483907 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.572447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4dae03ab-f56a-42ba-8b8d-30366408ccbe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101788 Aug 29 20:35:08.573045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 491/955] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:08.782165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.783429 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] [instance: cef448e4-4c7d-4e0b-8542-864ad660beb8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.789447 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.795723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.795723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.795723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.795723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.796109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.805254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] HTTP exception thrown: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Request method failure captured: Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 HTTP/1.1 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSGNMscb7s9FBDAJTKWYBhugTJP1a_HmANmSXRwKp1xnCp0AF8_RW444iSwKE9b2YwSDzg1M0JUdKeKEBOvMjoNVLJJereXVSoiog5l1y4AYorIH2DB3t4vBL1mL2VPcnIAS__3WFO-EWtlPbJrVUsNSEubNAAsHszgns9i_q86gpo0 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 8c28205e89c1441bbb3f1d68ac8893e4 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-TestShelveInstance-1639868828 Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:08.806885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8c28205e89c1441bbb3f1d68ac8893e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8c28205e89c1441bbb3f1d68ac8893e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8c28205e89c1441bbb3f1d68ac8893e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8c28205e89c1441bbb3f1d68ac8893e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-TestShelveInstance-1639868828 Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 8c28205e89c1441bbb3f1d68ac8893e4 Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-TestShelveInstance-1639868828 Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-TestShelveInstance-1639868828-project Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 95d668bfaf71417baac3c4336c33ed9f Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-TestShelveInstance-1639868828-project Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. Aug 29 20:35:08.808560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'cef448e4-4c7d-4e0b-8542-864ad660beb8'} Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:08.809532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. Aug 29 20:35:08.811091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:08.812482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Returning 404 to user: Instance cef448e4-4c7d-4e0b-8542-864ad660beb8 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:08.812482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a5819293-7d57-4f49-a334-af91e6f8cf7e tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8" status: 404 len: 111 microversion: 2.1 time: 0.030011 Aug 29 20:35:08.820454 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 465/956] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/cef448e4-4c7d-4e0b-8542-864ad660beb8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:09.066670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5c831b5b-c5a8-4fc5-915c-69e92431a802 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] Calling method '.version_select at 0x7f8987b04700>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:09.223244 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5c831b5b-c5a8-4fc5-915c-69e92431a802 tempest-TestShelveInstance-1639868828 tempest-TestShelveInstance-1639868828-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-105915495" status: 202 len: 0 microversion: 2.1 time: 0.160851 Aug 29 20:35:09.224035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 492/957] 10.222.0.85 () {58 vars in 1251 bytes} [Mon Aug 29 20:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-105915495 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:09.722965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969e255f-8170-47dd-a4ce-ef610d035370", "tag": "3ea8ac51-9524-45e9-84b1-5a510215cfde"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:09.737276 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.738673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.747224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.752051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] Creating event network-changed:3ea8ac51-9524-45e9-84b1-5a510215cfde for instance 969e255f-8170-47dd-a4ce-ef610d035370 on hv-cinder-85200 Aug 29 20:35:09.757620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-f9e13635-2d93-4a48-a3a9-772f4f9e78dd req-aaed1379-60e6-456c-b3e0-69b84a319761 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039164 Aug 29 20:35:09.758539 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 466/958] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:30.003144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=64 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:30.003877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:30.008280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.035733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.035733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.035733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.035733 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.036216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.036216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.036216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.048606 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f61d721-bb86-40a5-9018-7abd75b6e02a tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046958 Aug 29 20:35:30.049154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 493/959] 10.222.0.85 () {60 vars in 1343 bytes} [Mon Aug 29 20:35:29 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:30.116809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.117387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.119997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:30.120662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=40 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:30.125489 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.126467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.127072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.127711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.128186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.128610 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.153505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:30.592239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b996d9ef-9f4e-4b16-b4e4-6b8a43eccfc5 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 204 len: 0 microversion: 2.20 time: 0.479155 Aug 29 20:35:30.592775 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 467/960] 10.222.0.85 () {60 vars in 1280 bytes} [Mon Aug 29 20:35:30 2022] DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:35:30.602924 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.603525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.610503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.610984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.611421 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.612109 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.612736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.613225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.748409 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.756639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.762175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.762175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2314a9e2-77c4-4ce5-9be5-84daa1754f43 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.161097 Aug 29 20:35:30.762175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 494/961] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:30 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:31.783729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:31.784449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:31.791659 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.792143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.792598 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:31.793278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.793728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.794149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:31.923357 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:31.931405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:31.932882 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:31.934034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-77927261-aed0-4d78-b299-44e835a697ca tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1724 microversion: 2.20 time: 0.155231 Aug 29 20:35:31.934601 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 468/962] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:31 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:32.957909 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:32.958696 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:32.965757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:32.966237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:32.966712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:32.967388 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:32.967830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:32.968271 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.037930 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.046269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.047724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.048923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-afb09805-2b99-42ca-b5c1-6c2da238f434 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1656 microversion: 2.20 time: 0.095709 Aug 29 20:35:33.049481 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 495/963] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:32 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:33.164399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b133b3-0c87-4fce-837f-858cbc6843dc", "name": "network-vif-deleted", "tag": "4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:33.174939 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.175825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.175825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.189197 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] Creating event network-vif-deleted:4667bbc5-cd7d-4a24-b973-6b9e6bd22bc9 for instance 91b133b3-0c87-4fce-837f-858cbc6843dc on hv-cinder-85200 Aug 29 20:35:33.193906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-11563540-cf92-454d-a577-f69d826cb0b1 req-1e86f09f-a6f2-45d6-a7c2-35aaf183079b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033320 Aug 29 20:35:33.194550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 469/964] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:34.072943 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:34.073554 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:34.080687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.083810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.083810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.083810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.083810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.084197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.116018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.116536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.116971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.117549 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lazy-loading 'fault' on Instance uuid 91b133b3-0c87-4fce-837f-858cbc6843dc {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:34.158621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:34.166939 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:34.168446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859d36aa86bd403ca1d46b245efaef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f51ffa08494524b47ac220f1bd74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:34.169621 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f47b10cd-9009-4b6d-91b4-0e995120b5de tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 200 len: 1371 microversion: 2.20 time: 0.100739 Aug 29 20:35:34.171268 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 496/965] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:34 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:35.195151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:35.195846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:35.202067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:35.202540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:35.202973 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:35.204336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:35.204796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:35.205224 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:35.218095 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc HTTP/1.1 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:35.220284 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:35.222029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '91b133b3-0c87-4fce-837f-858cbc6843dc'} Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:35.223071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:35.224718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:35.226219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:35.226219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3fe0a5d8-1ef2-4b42-ad34-5f9b2f6b2ee9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 404 len: 111 microversion: 2.20 time: 0.031255 Aug 29 20:35:35.226219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 470/966] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:35 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:35:35.230637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-350d4cf0-f4df-4ff1-8d88-d2a4d4deadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '.version_select at 0x7f89878460d0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:35.393738 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-350d4cf0-f4df-4ff1-8d88-d2a4d4deadc9 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753962524" status: 204 len: 0 microversion: 2.20 time: 0.166785 Aug 29 20:35:35.394242 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 497/967] 10.222.0.85 () {60 vars in 1262 bytes} [Mon Aug 29 20:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753962524 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 20:35:37.437167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:37.437696 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:37.443683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.444182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.444632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.445317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.445767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.446190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.459371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc HTTP/1.1 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:37.460927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.462565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '91b133b3-0c87-4fce-837f-858cbc6843dc'} Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:37.463370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.464624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.465990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:37.465990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f40c5a44-628f-4dd6-a60a-82ed6eee9322 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 404 len: 111 microversion: 2.20 time: 0.029088 Aug 29 20:35:37.465990 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 471/968] 10.222.0.85 () {60 vars in 1280 bytes} [Mon Aug 29 20:35:37 2022] DELETE /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:35:37.471728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:37.472381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: 91b133b3-0c87-4fce-837f-858cbc6843dc] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:37.478999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.479485 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.479922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.480647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.481104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.481534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.495092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc HTTP/1.1 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:35:37.496771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.498369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '91b133b3-0c87-4fce-837f-858cbc6843dc'} Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:37.499259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. Aug 29 20:35:37.501232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:37.502798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance 91b133b3-0c87-4fce-837f-858cbc6843dc could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:37.502798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ae2913a4-99fa-4902-a256-feb7a9f4cb7e tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc" status: 404 len: 111 microversion: 2.20 time: 0.031314 Aug 29 20:35:37.502798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 498/969] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:37 2022] GET /compute/v2.1/servers/91b133b3-0c87-4fce-837f-858cbc6843dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:35:38.778377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:38.778881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:38.786241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:38.786756 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:38.787158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:38.787840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:38.788403 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:38.788840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:38.802559 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 HTTP/1.1 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:38.804134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.805678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'ebb79e74-0490-4071-80c8-c04cbea1da40'} Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:38.806542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.807986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.809453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:38.809453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cca01631-d621-4add-8dc3-a817401b0727 tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 404 len: 111 microversion: 2.20 time: 0.031103 Aug 29 20:35:38.809453 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 472/970] 10.222.0.85 () {60 vars in 1280 bytes} [Mon Aug 29 20:35:38 2022] DELETE /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:35:38.814589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:38.815227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] [instance: ebb79e74-0490-4071-80c8-c04cbea1da40] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:38.821649 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:38.822126 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:38.822558 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:38.823240 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:38.823689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:38.824112 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:38.837084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] HTTP exception thrown: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Request method failure captured: Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 HTTP/1.1 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSF057tJ3J8pvlAIdvFrBUzMahiuvAuzcH6nKmznboG6y-ACuWLXPj4QcRRtjjT2eedAWZXUsoeiGd70N6quUrghfUiGce44M0RvU3akkXyDmfapavnhMXxEHZDfPL1rhNZNWdvgOGHvWXGZkp3fziOwCfN18Mpjo7IlZ792QYopgxk Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:35:38.838580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6f51ffa08494524b47ac220f1bd74de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6f51ffa08494524b47ac220f1bd74de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: e6f51ffa08494524b47ac220f1bd74de Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1824995662 Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 859d36aa86bd403ca1d46b245efaef61 Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1824995662-project Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.840233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'ebb79e74-0490-4071-80c8-c04cbea1da40'} Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:38.841197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. Aug 29 20:35:38.842717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:38.844561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] Returning 404 to user: Instance ebb79e74-0490-4071-80c8-c04cbea1da40 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:38.844561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c58b57dc-28c3-4410-a1b8-a39509ff5c3d tempest-AttachVolumeShelveTestJSON-1824995662 tempest-AttachVolumeShelveTestJSON-1824995662-project] 10.222.0.85 "GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40" status: 404 len: 111 microversion: 2.20 time: 0.029858 Aug 29 20:35:38.844561 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 499/971] 10.222.0.85 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:38 2022] GET /compute/v2.1/servers/ebb79e74-0490-4071-80c8-c04cbea1da40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:35:45.724858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:45.725438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:45.732063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.732581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.733013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.733700 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.734150 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.735190 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.758705 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f711f4f7-357e-4f58-aa71-f55268c277fe tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/ips" status: 200 len: 149 microversion: 2.1 time: 0.037614 Aug 29 20:35:45.759274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 473/972] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:35:45 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:45.770863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58cd4108-1c9d-43a8-b53b-971f98ff60dd"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:45.773804 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:45.780507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.781072 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.782141 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.782903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.783435 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.783896 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.869441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: POST /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/os-volume_attachments HTTP/1.1 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 74 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:35:45.871053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {"volumeAttachment": {"volumeId": "58cd4108-1c9d-43a8-b53b-971f98ff60dd"}} Aug 29 20:35:45.872694 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'server_id': '969e255f-8170-47dd-a4ce-ef610d035370', 'body': {'volumeAttachment': {'volumeId': '58cd4108-1c9d-43a8-b53b-971f98ff60dd'}}} Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:45.873740 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:45.875309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 400 to user: Invalid volume: volume 58cd4108-1c9d-43a8-b53b-971f98ff60dd is already attached to instances: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d67755df-5091-4c1f-9625-37c6212b950c tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105778 Aug 29 20:35:45.876776 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 500/973] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:35:45 2022] POST /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:35:45.881266 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:45.881758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:45.887741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.888249 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.888685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.889361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.889812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.890257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.915414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:46.203070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-77a20747-df6d-4dd2-8f75-8ffceeaf7d1d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 204 len: 0 microversion: 2.1 time: 0.324456 Aug 29 20:35:46.204654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 474/974] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:35:45 2022] DELETE /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:35:46.216086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:46.217069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:46.228805 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.229298 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.229822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.233391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.233391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.233391 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.368010 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:46.376212 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-87cf814a-788b-4406-b1a5-732fa6741617 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1679 microversion: 2.1 time: 0.166729 Aug 29 20:35:46.376783 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 501/975] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:46 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:47.400068 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:47.400812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:47.407307 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.416340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.416340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.416340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.416340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.416761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.541126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:47.549448 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e68414ef-72a7-4332-bbcc-fa6ae066e219 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1679 microversion: 2.1 time: 0.154023 Aug 29 20:35:47.550020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 475/976] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:47 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:48.570984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:48.571631 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:48.578198 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.578690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.579192 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.579891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.580381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.580812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.747918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:48.752901 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-79b88447-47d0-47c6-b58e-cb1bf1e02ace tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1679 microversion: 2.1 time: 0.185370 Aug 29 20:35:48.754687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 502/977] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:48 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:48.962668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969e255f-8170-47dd-a4ce-ef610d035370", "name": "network-vif-deleted", "tag": "3ea8ac51-9524-45e9-84b1-5a510215cfde"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:48.973985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.974468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.974893 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.986231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] Creating event network-vif-deleted:3ea8ac51-9524-45e9-84b1-5a510215cfde for instance 969e255f-8170-47dd-a4ce-ef610d035370 on hv-cinder-85200 Aug 29 20:35:48.991346 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-3c27d396-d567-49f5-9187-63eae683a380 req-5e80379e-d44c-486e-8e04-f2b27d7dc93a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Aug 29 20:35:48.992259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 476/978] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:49.776852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:49.777456 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:49.784445 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.786333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.786333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.786333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.786767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.786995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.826791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.826791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.826791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.826791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'fault' on Instance uuid 969e255f-8170-47dd-a4ce-ef610d035370 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:49.870941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:49.879700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ec6746b6-b495-4621-a2e4-2019222c9af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 200 len: 1330 microversion: 2.1 time: 0.106977 Aug 29 20:35:49.880701 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 503/979] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:49 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:50.902716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.903498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.909828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.910324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.910765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.911451 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.911905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.912392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.925794 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 HTTP/1.1 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:50.927438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:35:50.929137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '969e255f-8170-47dd-a4ce-ef610d035370'} Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:50.929980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:35:50.931280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:50.932482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:50.932482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-75d0b06f-8abe-4a08-8798-d93331060fba tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 404 len: 111 microversion: 2.1 time: 0.031187 Aug 29 20:35:50.932482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 477/980] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:50.939053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d64712a1-a177-4a5c-b95a-e81ee00257bc tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '.version_select at 0x7f8987651a60>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:51.036688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d64712a1-a177-4a5c-b95a-e81ee00257bc tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451619131" status: 202 len: 0 microversion: 2.1 time: 0.098872 Aug 29 20:35:51.036688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 504/981] 10.222.0.85 () {58 vars in 1218 bytes} [Mon Aug 29 20:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451619131 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:51.817977 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:51.818467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:51.824638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.825153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.825590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.826492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.826945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.827373 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.909917 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'services' on Instance uuid 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:52.145503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-86df2ee1-b2dc-44da-ad3c-787382d81cb0 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments/58cd4108-1c9d-43a8-b53b-971f98ff60dd" status: 202 len: 0 microversion: 2.1 time: 0.331256 Aug 29 20:35:52.149388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 478/982] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:35:51 2022] DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments/58cd4108-1c9d-43a8-b53b-971f98ff60dd => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:52.156756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:52.159639 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:52.166345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.166876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.167321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.168015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.168508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.168935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.197761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1c6ff93c-09a1-4b1a-b5eb-1e2e71486b70 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 29 20:35:52.198241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 505/983] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:35:52 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:53.211299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:53.213936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:53.220599 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.221083 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.221523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.222206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.222663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.223087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.252466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9d2b0e9d-632e-41e4-8c2b-10ef4c6c4941 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Aug 29 20:35:53.253013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 479/984] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:35:53 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:54.264436 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:54.266765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.273230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.273717 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.274154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.274925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.275392 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.275819 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.312033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0cfed400-d58c-4d2f-b491-6ca2dc755daa tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051635 Aug 29 20:35:54.312643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 506/985] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:35:54 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:35:54.376561 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:54.377683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.384033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.388155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.388155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.388155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.388155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.388562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.411478 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:54.820287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0c3583d3-0dc6-4523-b9cc-9e043e14841d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 204 len: 0 microversion: 2.1 time: 0.447404 Aug 29 20:35:54.820866 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 480/986] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:35:54 2022] DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:35:54.829092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:54.829815 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.836542 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.837722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.837722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.838315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.838782 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.839211 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.156157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:55.163787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-786523b1-2111-4668-aa3c-2da6c59328ae tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1682 microversion: 2.1 time: 0.338655 Aug 29 20:35:55.164373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 507/987] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:54 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:56.186119 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:56.186844 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:56.193421 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.195374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.195374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.195374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.195689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.195888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.332878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:56.340746 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d4d0f655-c3aa-4339-9551-e1d8039bfcf9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1682 microversion: 2.1 time: 0.158854 Aug 29 20:35:56.341315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 481/988] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:56 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:57.364400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:57.365012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:57.372455 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.374229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.374670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.375386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.378383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.383039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.437096 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a", "name": "network-vif-deleted", "tag": "2b462b58-a519-4754-ba5f-1e2675987f28"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:57.448971 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.449720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.450323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.450734 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:57.459221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a4297c76-fa4a-4cd6-acf2-57b51a189152 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1614 microversion: 2.1 time: 0.099601 Aug 29 20:35:57.463349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 508/989] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:57 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:57.463483 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:57.464179 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] Creating event network-vif-deleted:2b462b58-a519-4754-ba5f-1e2675987f28 for instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a on hv-cinder-85200 Aug 29 20:35:57.469280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-b9280aea-1d14-4a97-8e51-8aa08e415e91 req-a4e29c32-9096-42b4-8bf5-b0248d2a4e25 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Aug 29 20:35:57.474104 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 482/990] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:58.481644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.482420 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:58.489497 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.490086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.490613 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.491371 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.491946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.492477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.525551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.525974 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.526454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.526898 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'fault' on Instance uuid 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:58.568422 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.576496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d034cace-8047-4e92-af71-7b7882e7c0cf tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 200 len: 1331 microversion: 2.1 time: 0.098914 Aug 29 20:35:58.577071 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 509/991] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:59.599593 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:59.600277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:59.607124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.607608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.608047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.608792 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.609246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.609672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.623378 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a HTTP/1.1 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:35:59.625016 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:35:59.626609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a'} Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:59.627597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:35:59.629088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:35:59.630455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:59.630455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0e84d86f-a82d-4eb4-b0d9-f1ea0b15ffee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 404 len: 111 microversion: 2.1 time: 0.032304 Aug 29 20:35:59.630455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 483/992] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:59 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:59.635318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d24bca1f-014d-44f9-8051-aaf164c9dd80 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '.version_select at 0x7f89877f5e50>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:59.729674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d24bca1f-014d-44f9-8051-aaf164c9dd80 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475278595" status: 202 len: 0 microversion: 2.1 time: 0.098067 Aug 29 20:35:59.730299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 510/993] 10.222.0.85 () {58 vars in 1221 bytes} [Mon Aug 29 20:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475278595 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:36:00.514804 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f62c70be-9058-46be-8d4d-d580c8fb3047 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: .version_select at 0x7f8987548dc0>, body: {"keypair": {"name": "tempest-keypair-1286761508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJACGBHC/YJAXjJn0RGhzPTUqHLADrFeyShCF20YtZDPwlPq3ZIJE3ljTyz0Oo9+cYi5xCq9suYntgDK+YFhbeVQ+jwPEeJcu4Na6J9lH5HPQCepI9mmg6fM/AI0aT/V6g=="}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:00.531160 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-f62c70be-9058-46be-8d4d-d580c8fb3047 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:36:00.535656 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-f62c70be-9058-46be-8d4d-d580c8fb3047 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:36:00.638630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f62c70be-9058-46be-8d4d-d580c8fb3047 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127908 Aug 29 20:36:00.646676 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 484/994] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:36:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:03.026471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1806196065", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e83db8-f1ae-4fb9-8271-926f248d148a"}], "security_groups": [{"name": "tempest-securitygroup--1371689241"}], "key_name": "tempest-keypair-1286761508", "user_data": "}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:03.034625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:03.131583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] validate_networks() for [('f1e83db8-f1ae-4fb9-8271-926f248d148a', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:36:03.506213 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:36:03.506998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:36:03.507208 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:36:03.507643 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:36:03.508051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:36:03.516800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:03.517310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:03.517747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:03.518517 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:03.518972 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:03.519396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:03.526352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=89 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:03.537108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:36:03.541079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:36:03.552505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:36:03.554846 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:36:03.744471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c6250a01-f031-4e11-8b5c-c579a5d38558 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723164 Aug 29 20:36:03.745133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 511/995] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:36:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:36:03.756295 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a80cbaa5-3e63-41f5-b478-a12bd93f139f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:03.756818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a80cbaa5-3e63-41f5-b478-a12bd93f139f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:03.758713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:03.814012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a80cbaa5-3e63-41f5-b478-a12bd93f139f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:03.821151 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a80cbaa5-3e63-41f5-b478-a12bd93f139f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1242 microversion: 2.1 time: 0.069160 Aug 29 20:36:03.821581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 485/996] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:03 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:04.843022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:04.843695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:04.855759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.855759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.855759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.855759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.856281 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.856281 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.918807 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:04.927193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d6ba1bc9-36ce-4154-a2c2-92e804010c64 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1246 microversion: 2.1 time: 0.089482 Aug 29 20:36:04.927792 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 512/997] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:04 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:05.948766 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:05.949798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:05.956851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.957322 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.957748 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.958502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.958967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.959405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:06.022143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:06.030241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-698ee44a-8ec6-4a6b-8f3e-fefbe641ff63 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1294 microversion: 2.1 time: 0.085354 Aug 29 20:36:06.031013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 486/998] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:05 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:07.051469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:07.052099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:07.059154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.059850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.060321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.061324 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.061785 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.062376 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.278802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:07.287220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-13d6d063-6cd7-4863-bd0d-f48392bd06e7 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.240209 Aug 29 20:36:07.287800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 513/999] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:07 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:07.909446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15f73fe-a100-43b8-b9ce-f59456369fa8", "tag": "bb27e840-7462-4a15-b59d-b2fbd5a8af57"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:07.919460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.919934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.920409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.936912 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] Creating event network-changed:bb27e840-7462-4a15-b59d-b2fbd5a8af57 for instance b15f73fe-a100-43b8-b9ce-f59456369fa8 on hv-cinder-85200 Aug 29 20:36:07.943905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-6351c205-e206-4ad3-9840-c0c9a83a90d4 req-da313b7e-0264-4830-8e3f-626b02ae7662 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038329 Aug 29 20:36:07.945004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 487/1000] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:08.309280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:08.309817 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:08.316743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:08.317232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:08.322178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:08.322178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:08.322178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:08.322178 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:08.455553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:08.463788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ebc5d92d-4ee8-44d0-876e-4a63a429119e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.158533 Aug 29 20:36:08.464595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 514/1001] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:08 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:09.486855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:09.487544 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:09.494206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:09.495596 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:09.496126 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:09.496730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:09.497241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:09.498755 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:09.784619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:09.793670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7e189041-f887-4ec4-bc1a-adef609b382e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.311862 Aug 29 20:36:09.794002 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 488/1002] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:09 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:10.813174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:10.813939 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:10.821352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.821890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.822344 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.823041 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.823498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.823954 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:11.005669 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:11.015225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-36e883b8-4d3b-47a6-99cb-d0c3ebdd7c69 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.205924 Aug 29 20:36:11.019595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 515/1003] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:10 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:12.039105 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:12.039703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:12.046173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:12.046651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:12.053613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:12.053613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:12.053613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:12.053613 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:12.226541 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:12.234809 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fab676ac-d6c0-499f-84e9-433a507c37ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.199546 Aug 29 20:36:12.235384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 489/1004] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:12 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:13.120977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15f73fe-a100-43b8-b9ce-f59456369fa8", "name": "network-vif-plugged", "status": "completed", "tag": "bb27e840-7462-4a15-b59d-b2fbd5a8af57"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:13.131076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.131596 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.132078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.143258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] Creating event network-vif-plugged:bb27e840-7462-4a15-b59d-b2fbd5a8af57 for instance b15f73fe-a100-43b8-b9ce-f59456369fa8 on hv-cinder-85200 Aug 29 20:36:13.148579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-cc64090a-91ee-4997-9557-39a32156bb15 req-3e08a3c7-1624-4149-812c-7779a5b06470 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Aug 29 20:36:13.149303 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 516/1005] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:13.255841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:13.256487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:13.263340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.263833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.264294 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.264992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.265446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.265869 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.399985 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:13.407732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d0c92141-1089-48b6-9b5f-9eefe5c38953 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.155703 Aug 29 20:36:13.408487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 490/1006] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:13 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:14.426921 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:14.427627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=6 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:14.432258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:14.432970 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:14.439189 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.440500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.440835 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.441530 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.441986 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.442641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.579941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:14.588705 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fb0df9e4-b411-4359-963d-7ecf10e89c02 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1368 microversion: 2.1 time: 0.162616 Aug 29 20:36:14.589348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 517/1007] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:14 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:15.609810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:15.610351 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:15.612395 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:15.617688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.618132 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.618566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.619275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.619713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.620134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.755450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:15.763125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ea358d7d-db5d-4abf-9f23-68eace1e8dc9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1558 microversion: 2.1 time: 0.157368 Aug 29 20:36:15.763721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 491/1008] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:15 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:15.787057 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:15.787569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:15.794982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.795450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.795892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.796725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.797180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.797607 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.873026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-cc5bac96-dc71-4171-bb3c-0750e649fb95 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089803 Aug 29 20:36:15.873622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 518/1009] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:36:15 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:16.899954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15f73fe-a100-43b8-b9ce-f59456369fa8", "tag": "bb27e840-7462-4a15-b59d-b2fbd5a8af57"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:16.910323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.910888 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.911387 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.922677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] Creating event network-changed:bb27e840-7462-4a15-b59d-b2fbd5a8af57 for instance b15f73fe-a100-43b8-b9ce-f59456369fa8 on hv-cinder-85200 Aug 29 20:36:16.927868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-29734791-f738-41bb-805c-731f5f2cec73 req-88df5df9-6e7f-4a04-83e0-dc69d0e58c9b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031877 Aug 29 20:36:16.928619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 492/1010] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:17.223960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1410144677", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "networks": [{"uuid": "9ec748fc-c657-49d5-8ad4-a388cea162d3"}]}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:17.279215 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] validate_networks() for [('9ec748fc-c657-49d5-8ad4-a388cea162d3', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:36:17.644506 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:36:17.645013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:36:17.645486 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:36:17.645886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:36:17.646287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:36:17.655623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:17.656105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:17.656582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:17.657315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:17.657751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:17.658290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:17.676054 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Getting quotas for project a697de0f7a4d4b718d46d97f17c813b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:36:17.680323 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Getting quotas for user 299a032386cb43c381f3f418c142d30f and project a697de0f7a4d4b718d46d97f17c813b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:36:17.691794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:36:17.694107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:36:18.014750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-f07e0e1d-9281-4f8f-add3-91388edd9ca6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794536 Aug 29 20:36:18.015405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 519/1011] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:36:18.027551 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d214ca42-9383-4c4c-aded-5495957a88a1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:18.028269 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d214ca42-9383-4c4c-aded-5495957a88a1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:18.097143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d214ca42-9383-4c4c-aded-5495957a88a1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:18.105319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d214ca42-9383-4c4c-aded-5495957a88a1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1214 microversion: 2.1 time: 0.082844 Aug 29 20:36:18.107278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 493/1012] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:18 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:19.127627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:19.128264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:19.134328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:19.134812 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:19.135254 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:19.135944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:19.136425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:19.136849 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:19.203993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:19.211700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c004a3ee-4edd-4475-b685-9168c2599fd1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1218 microversion: 2.1 time: 0.089156 Aug 29 20:36:19.212424 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 520/1013] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:19 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:20.232374 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:20.236660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:20.240897 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:20.241383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:20.241826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:20.242517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:20.242973 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:20.243398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:20.304502 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:20.312090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1f5f8baa-0ecf-4f36-90fa-096f03105b37 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1266 microversion: 2.1 time: 0.083610 Aug 29 20:36:20.319400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 494/1014] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:20 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:21.332736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:21.333345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:21.340187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.340690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.341125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.341816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.342267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.342695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.475758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:21.483787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5e8d94a2-aced-4d78-b845-7a6c42865863 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.154955 Aug 29 20:36:21.484454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 521/1015] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:21 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:22.061172 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0948fe-3ae4-4d40-995c-7c796a809aa4", "tag": "7f5587e3-4526-4b41-8f84-e2bc0657c131"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:22.071463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:22.071975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:22.072467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.085841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] Creating event network-changed:7f5587e3-4526-4b41-8f84-e2bc0657c131 for instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 on hv-cinder-85200 Aug 29 20:36:22.090847 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-a2786f92-a677-463a-9e87-1b970397311e req-93480e07-87d7-4600-94ed-c27bd624e40c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033758 Aug 29 20:36:22.091805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 495/1016] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:22.505975 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:22.506721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:22.513286 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:22.513767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:22.514194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.514916 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:22.515369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:22.515794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.648354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:22.655994 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-21f3092b-ca0b-4022-a90d-605a33aed981 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.154524 Aug 29 20:36:22.656583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 522/1017] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:22 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:23.677686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:23.678420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:23.685057 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.685611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.686052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.686787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.687242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.687667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.818015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:23.825689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-df2044d5-c8a6-4a30-965c-a3c902f66c9f tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.152478 Aug 29 20:36:23.826259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 496/1018] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:23 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:24.846890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:24.847500 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:24.853684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.854163 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.854597 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:24.855307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.855759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.856193 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:24.990176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:24.997806 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9533f854-ea47-401f-8d09-e973c75ed2c5 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.154831 Aug 29 20:36:24.998363 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 523/1019] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:24 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:26.019503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:26.020181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:26.027012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.027490 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.027918 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:26.028632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.029080 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.029494 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:26.156027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:26.163602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f3bcc0fd-7933-4564-9691-763857f06848 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.149057 Aug 29 20:36:26.164185 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 497/1020] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:26 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:27.153346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0948fe-3ae4-4d40-995c-7c796a809aa4", "name": "network-vif-plugged", "status": "completed", "tag": "7f5587e3-4526-4b41-8f84-e2bc0657c131"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:27.164282 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:27.164752 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:27.165184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.176090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] Creating event network-vif-plugged:7f5587e3-4526-4b41-8f84-e2bc0657c131 for instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 on hv-cinder-85200 Aug 29 20:36:27.181187 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-6b651148-384c-4372-a79b-11c647eb98b2 req-997d0db7-71bc-4134-b138-51bfd017a12b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Aug 29 20:36:27.181773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 524/1021] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:27.183522 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:27.184213 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:27.190497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:27.190980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:27.191413 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.192098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:27.192580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:27.193002 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.324455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:27.333197 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f29b2ad8-aefa-4792-b99f-fb4df8b6f20d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.153732 Aug 29 20:36:27.339365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 498/1022] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:27 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:28.351625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:28.352334 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=6 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:28.356757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:28.357457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:28.363522 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.364000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.364541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.365207 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.365658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.366078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.499925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:28.508015 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-320e53a5-b596-4dc5-958e-d0ac91da3966 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1314 microversion: 2.1 time: 0.157396 Aug 29 20:36:28.508614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 525/1023] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:28 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:29.529407 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:29.530017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:29.531997 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:29.537303 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.541248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.541248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:29.541248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.541248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.541575 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:29.670689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:29.678472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2c2fd529-fda1-4bb6-ad50-f8d68ef3a55d tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1498 microversion: 2.1 time: 0.152978 Aug 29 20:36:29.679041 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 499/1024] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:29 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:30.608395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:30.608993 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:30.615491 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.615977 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.616441 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.617159 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.617616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.618040 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.643514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:36:30.934082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-235de1c2-ae2c-4202-99bb-7ccbde330ccd tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 204 len: 0 microversion: 2.1 time: 0.329342 Aug 29 20:36:30.934730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 526/1025] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:36:30 2022] DELETE /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:36:30.943820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:30.944474 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:30.952293 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.952825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.953297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.954125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.954579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.955003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.957668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=69 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:31.087100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:31.095140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f159feff-c906-4541-a4da-9a0a3b593712 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1504 microversion: 2.1 time: 0.156087 Aug 29 20:36:31.095707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 500/1026] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:30 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:32.115951 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:32.116674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:32.123119 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.123605 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.124046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.124769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.125226 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.125654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.257460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:32.265215 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-66a750dc-5499-4704-8c77-0388edd215ef tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1504 microversion: 2.1 time: 0.153647 Aug 29 20:36:32.265784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 527/1027] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:32 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:33.149726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0948fe-3ae4-4d40-995c-7c796a809aa4", "name": "network-vif-deleted", "tag": "7f5587e3-4526-4b41-8f84-e2bc0657c131"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:33.160111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.160607 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.161035 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.171909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] Creating event network-vif-deleted:7f5587e3-4526-4b41-8f84-e2bc0657c131 for instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 on hv-cinder-85200 Aug 29 20:36:33.177182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-fd311820-af44-4e09-ae37-c0a5a975182d req-80366145-0243-4880-b1bf-62a68bd204a1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 Aug 29 20:36:33.177780 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 501/1028] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:33.287751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:33.290428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:33.299636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.302025 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.302519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.303668 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.304305 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.305352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.369862 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:33.377786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c9948e41-8809-466a-af0a-ee0bdd5b7253 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 200 len: 1462 microversion: 2.1 time: 0.094651 Aug 29 20:36:33.380638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 528/1029] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:33 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:34.401916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:34.402611 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: 8c0948fe-3ae4-4d40-995c-7c796a809aa4] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:34.409192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.411311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.411311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.411311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.411311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.411818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.427053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] HTTP exception thrown: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Request method failure captured: Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 HTTP/1.1 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSM_-c9TNEwJue4m5LUNzjmL7mvNTwF9_TGhcBg-tr78b3ZzF94a8plt8Q-qrXvqC7-_h0io-qthuhclUOpRjLrz0V2JfDCbNLf2c6-f1HSmdlU7DeSaPjbkyTVga71SvCyErgJ6CGiMidL3z3bCmD_X4AxwowmnuKzhZXqaCm3X68M Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: a697de0f7a4d4b718d46d97f17c813b7 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:36:34.428725 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a697de0f7a4d4b718d46d97f17c813b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: a697de0f7a4d4b718d46d97f17c813b7 Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesActionsTest-1014033591-project Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 299a032386cb43c381f3f418c142d30f Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesActionsTest-1014033591-project Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. Aug 29 20:36:34.435877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '8c0948fe-3ae4-4d40-995c-7c796a809aa4'} Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:36:34.437063 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. Aug 29 20:36:34.438666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:36:34.440127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Returning 404 to user: Instance 8c0948fe-3ae4-4d40-995c-7c796a809aa4 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:36:34.440127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a98f4552-7382-4736-bf36-3722907ffeaa tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4" status: 404 len: 111 microversion: 2.1 time: 0.032766 Aug 29 20:36:34.440127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 502/1030] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:34 2022] GET /compute/v2.1/servers/8c0948fe-3ae4-4d40-995c-7c796a809aa4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:36:34.479632 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-663239682", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "networks": [{"uuid": "9ec748fc-c657-49d5-8ad4-a388cea162d3"}]}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:34.488619 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:34.534419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.network.neutron [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] validate_networks() for [('9ec748fc-c657-49d5-8ad4-a388cea162d3', None, None, None, None, None)] {{(pid=121467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:36:34.882043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Flavor limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:36:34.882469 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Image limits 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:36:34.882944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Flavor pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:36:34.883390 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Image pref 0:0:0 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:36:34.883801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.virt.hardware [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:36:34.892582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.893065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.894078 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.894768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.895220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.895645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.902759 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:34.913736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Getting quotas for project a697de0f7a4d4b718d46d97f17c813b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:36:34.917756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Getting quotas for user 299a032386cb43c381f3f418c142d30f and project a697de0f7a4d4b718d46d97f17c813b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:36:34.929610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Going to run 1 instances... {{(pid=121467) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:36:34.931958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:36:35.067511 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ac33e143-4e50-43ed-81c1-bedf4a407108 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591720 Aug 29 20:36:35.068259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 529/1031] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:36:35.079062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ff71e5d7-42c8-409c-9558-b93162dbf14c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:35.079674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ff71e5d7-42c8-409c-9558-b93162dbf14c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:35.137900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ff71e5d7-42c8-409c-9558-b93162dbf14c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:35.145195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ff71e5d7-42c8-409c-9558-b93162dbf14c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1213 microversion: 2.1 time: 0.070054 Aug 29 20:36:35.146437 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 503/1032] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:35 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:36.166398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-774319ad-8d09-487b-98fc-1b35bc9f63de tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:36.167032 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-774319ad-8d09-487b-98fc-1b35bc9f63de tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:36.220508 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-774319ad-8d09-487b-98fc-1b35bc9f63de tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:36.227259 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-774319ad-8d09-487b-98fc-1b35bc9f63de tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1213 microversion: 2.1 time: 0.065624 Aug 29 20:36:36.227816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 530/1033] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:36 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:37.249173 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:37.249686 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:37.256580 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:37.257058 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:37.257556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:37.258342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:37.258826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:37.259288 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:37.321948 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:37.329885 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ae9bb166-61a9-43fb-a636-5affa5de2684 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1265 microversion: 2.1 time: 0.085159 Aug 29 20:36:37.330449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 504/1034] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:37 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:38.351138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:38.351753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:38.358556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:38.359065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:38.360412 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:38.361490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:38.362005 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:38.362875 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:38.500684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:38.509197 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8850234f-bcff-451d-8d55-9e79b8c9e3da tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.161960 Aug 29 20:36:38.509766 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 531/1035] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:38 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:39.276976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda09d87-5137-47e9-8af2-b945138acc54", "tag": "40a86d72-de18-4ce9-9851-812c396ffb36"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:39.288238 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:39.288718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:39.289152 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:39.300368 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] Creating event network-changed:40a86d72-de18-4ce9-9851-812c396ffb36 for instance cda09d87-5137-47e9-8af2-b945138acc54 on hv-cinder-85200 Aug 29 20:36:39.305169 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-99ba7f40-bb11-4972-8260-093151bc2cb3 req-91034832-0a8f-4571-ae17-e168d402522f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Aug 29 20:36:39.305769 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 505/1036] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:39.530230 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:39.530836 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:39.537446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:39.537923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:39.538352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:39.539037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:39.539484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:39.539932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:39.676538 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:39.685647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ff033060-6935-41cc-95b3-0218952a68e1 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.159218 Aug 29 20:36:39.686419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 532/1037] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:39 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:40.707960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:40.708679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:40.710589 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=48 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:40.715402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:40.715880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:40.716341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:40.717027 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:40.717486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:40.717910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:40.845143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:40.852693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ed47885e-6937-49c9-9096-753521ab4043 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.149518 Aug 29 20:36:40.853259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 506/1038] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:40 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:41.873808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:41.874335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:41.881315 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:41.881797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:41.882227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:41.882907 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:41.883354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:41.883781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.010543 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:42.018073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dedd82e2-e015-45a4-b3ff-baf31565d77a tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.148218 Aug 29 20:36:42.018630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 533/1039] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:41 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:43.039527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:43.040145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:43.046608 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:43.047294 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:43.047519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:43.048225 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:43.048683 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:43.049106 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:43.182678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:43.190343 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c8c0cd16-4878-4410-96cd-e23931d61af6 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.155363 Aug 29 20:36:43.190914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 507/1040] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:43 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:44.212634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:44.213241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:44.219630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.220113 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.220587 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.221264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.221713 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.222130 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.351980 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:44.359796 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0895da7e-cbee-4943-9cf9-7b6319ca4b64 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.151125 Aug 29 20:36:44.360405 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 534/1041] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:44 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:45.218124 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda09d87-5137-47e9-8af2-b945138acc54", "name": "network-vif-plugged", "status": "completed", "tag": "40a86d72-de18-4ce9-9851-812c396ffb36"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:45.225458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:45.229328 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.229798 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.230231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.241208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] Creating event network-vif-plugged:40a86d72-de18-4ce9-9851-812c396ffb36 for instance cda09d87-5137-47e9-8af2-b945138acc54 on hv-cinder-85200 Aug 29 20:36:45.246394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-74c41fa5-09db-41dd-a09d-836b39526066 req-3afbfa93-9550-4bd9-8c26-4cc1e1dd35e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Aug 29 20:36:45.247336 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 508/1042] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:45.381393 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:45.382000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:45.383895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:45.389354 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.389830 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.394052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.394052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.394052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.394052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.520277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:45.528147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ad5373a7-1c79-4879-84e9-2ddf8ad5c88e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.150727 Aug 29 20:36:45.528685 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 535/1043] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:45 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:46.549396 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:46.550007 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:46.556881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.557352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.557781 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:46.558457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.558905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.559317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:46.694863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:46.702519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f0ee144f-0d5d-44c5-97e5-017f532da065 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1313 microversion: 2.1 time: 0.157763 Aug 29 20:36:46.703087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 509/1044] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:46 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:47.722961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:47.723563 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:47.725788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=8 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:47.731414 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:47.731927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:47.732429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:47.733125 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:47.733607 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:47.734115 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:47.863946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:47.877585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d140b162-1e88-40a0-bbc1-360d0315de8e tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1497 microversion: 2.1 time: 0.152645 Aug 29 20:36:47.877585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 536/1045] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:47 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:48.821958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:48.822480 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:48.828982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.829462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.829900 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.830584 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.831037 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.831462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.858754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:36:49.196369 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a27f62c2-dac8-4d49-81ea-23d2b71f142c tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 204 len: 0 microversion: 2.1 time: 0.377975 Aug 29 20:36:49.196952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 510/1046] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:36:48 2022] DELETE /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:36:49.205046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:49.208239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:49.212803 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:49.213290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:49.213728 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:49.214418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:49.214873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:49.215300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:49.341652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:49.349448 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e76a4aca-f2f7-4aa9-8f8c-877511aeaa72 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1503 microversion: 2.1 time: 0.148224 Aug 29 20:36:49.350030 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 537/1047] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:49 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:50.370880 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:50.371583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:50.378034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.378505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.379571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.380296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.380753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.381180 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.509457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:50.517133 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6f70a365-c369-4ad8-b24e-578b60bb3a90 tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1503 microversion: 2.1 time: 0.150529 Aug 29 20:36:50.517693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 511/1048] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:50 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:51.478672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda09d87-5137-47e9-8af2-b945138acc54", "name": "network-vif-deleted", "tag": "40a86d72-de18-4ce9-9851-812c396ffb36"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:51.489442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.489917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.490395 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.501378 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] Creating event network-vif-deleted:40a86d72-de18-4ce9-9851-812c396ffb36 for instance cda09d87-5137-47e9-8af2-b945138acc54 on hv-cinder-85200 Aug 29 20:36:51.506600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-2ace857c-02b3-4b32-9428-0b8165ba3e0b req-cb86176c-c846-4dd6-8eb4-23e7c639727c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Aug 29 20:36:51.507559 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 538/1049] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:51.538714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:51.539333 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:51.545961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.546442 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.546979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.547690 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.548122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.548572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.614460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a032386cb43c381f3f418c142d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a697de0f7a4d4b718d46d97f17c813b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:51.624015 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1675d90d-ac02-46f9-a8e0-872b8de4f4ae tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 200 len: 1461 microversion: 2.1 time: 0.089505 Aug 29 20:36:51.624629 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 512/1050] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:51 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:52.646326 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:52.647117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] [instance: cda09d87-5137-47e9-8af2-b945138acc54] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:52.653982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.654463 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.654890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.655571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.656014 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.656498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.670787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] HTTP exception thrown: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Request method failure captured: Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 HTTP/1.1 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSM_-c9TNEwJue4m5LUNzjmL7mvNTwF9_TGhcBg-tr78b3ZzF94a8plt8Q-qrXvqC7-_h0io-qthuhclUOpRjLrz0V2JfDCbNLf2c6-f1HSmdlU7DeSaPjbkyTVga71SvCyErgJ6CGiMidL3z3bCmD_X4AxwowmnuKzhZXqaCm3X68M Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: a697de0f7a4d4b718d46d97f17c813b7 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:36:52.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a697de0f7a4d4b718d46d97f17c813b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a697de0f7a4d4b718d46d97f17c813b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: a697de0f7a4d4b718d46d97f17c813b7 Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesActionsTest-1014033591 Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesActionsTest-1014033591-project Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 299a032386cb43c381f3f418c142d30f Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesActionsTest-1014033591-project Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. Aug 29 20:36:52.688995 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'cda09d87-5137-47e9-8af2-b945138acc54'} Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:36:52.689886 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. Aug 29 20:36:52.691287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:36:52.692697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] Returning 404 to user: Instance cda09d87-5137-47e9-8af2-b945138acc54 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:36:52.692697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-7a945831-aa17-40e3-9d61-2363edcdd00b tempest-VolumesActionsTest-1014033591 tempest-VolumesActionsTest-1014033591-project] 10.222.0.85 "GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54" status: 404 len: 111 microversion: 2.1 time: 0.032564 Aug 29 20:36:52.692697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 539/1051] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:52 2022] GET /compute/v2.1/servers/cda09d87-5137-47e9-8af2-b945138acc54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:36:52.974887 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:52.975405 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:52.982026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.982515 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.982960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.983655 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.984120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.984566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:53.008450 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-69c427ab-ce6c-409e-aa1d-594e477a703a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/ips" status: 200 len: 150 microversion: 2.1 time: 0.037316 Aug 29 20:36:53.014155 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 513/1052] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:36:52 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:54.686519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "857e5d8a-27c7-4b9e-9996-59e3d2206f47"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:54.688944 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:54.695377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.695858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.696337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:54.697027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.697481 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.697912 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:58.082414 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4f02a816-6411-41fd-bcd1-0e66f917fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.399768 Aug 29 20:36:58.084368 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 540/1053] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:36:54 2022] POST /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments => generated 194 bytes in 3403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:05.793055 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "857e5d8a-27c7-4b9e-9996-59e3d2206f47"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:05.797335 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:05.800026 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:05.801064 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:05.806435 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:05.806886 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:05.807519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:05.808468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:05.808932 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:05.809386 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:05.988833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: POST /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments HTTP/1.1 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 74 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:37:05.992461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {"volumeAttachment": {"volumeId": "857e5d8a-27c7-4b9e-9996-59e3d2206f47"}} Aug 29 20:37:05.993966 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'server_id': 'b15f73fe-a100-43b8-b9ce-f59456369fa8', 'body': {'volumeAttachment': {'volumeId': '857e5d8a-27c7-4b9e-9996-59e3d2206f47'}}} Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:37:05.994749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:05.996042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 400 to user: Invalid volume: volume 857e5d8a-27c7-4b9e-9996-59e3d2206f47 is already attached to instances: b15f73fe-a100-43b8-b9ce-f59456369fa8 {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8a2dc65f-0093-4a47-a17f-d1e43ac1377d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206358 Aug 29 20:37:05.998609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 514/1054] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:37:05 2022] POST /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:37:06.077811 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:06.082498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:06.083220 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:06.091043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.091852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.092428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:06.093191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.093737 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.094222 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:06.184956 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'services' on Instance uuid b15f73fe-a100-43b8-b9ce-f59456369fa8 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:37:06.315398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:06.425450 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ff6b4ef4-2a62-400e-bcd4-de3ee563ff6d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments/857e5d8a-27c7-4b9e-9996-59e3d2206f47" status: 202 len: 0 microversion: 2.1 time: 0.348922 Aug 29 20:37:06.426037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 541/1055] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:37:06 2022] DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments/857e5d8a-27c7-4b9e-9996-59e3d2206f47 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:37:06.436439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:06.438710 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:06.447394 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.447999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.448591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:06.449431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.449943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.450432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:06.491217 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-521b7e02-f643-4f17-9c74-cd8793fe820d tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058440 Aug 29 20:37:06.491896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 515/1056] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:37:06 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:07.506314 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:07.508608 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:07.515829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:07.516428 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:07.516899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:07.517743 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:07.518364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:07.518771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:07.553063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0e472798-265f-4c7a-95d2-31ed534cf6e5 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052194 Aug 29 20:37:07.553615 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 542/1057] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:37:07 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:08.565635 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:08.567716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:08.575052 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.575530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.575963 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.576701 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.577144 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.577566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.616352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5d7e4062-1900-4e06-97da-703104be77c9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054910 Aug 29 20:37:08.617297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 516/1058] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:37:08 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:37:08.686642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:08.687267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:08.700588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.701386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.702007 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.702983 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.703630 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.704093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.736999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:37:09.093988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1ebdbf83-88e1-44f0-8507-626e09eb191e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 204 len: 0 microversion: 2.1 time: 0.413239 Aug 29 20:37:09.094610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 543/1059] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:37:08 2022] DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:37:09.105070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:09.106135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:09.112571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:09.113153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:09.113667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:09.114492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:09.115668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:09.116200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:09.256687 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:09.266043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7d2597ce-3422-4e9c-af90-fecede1c3ec9 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1683 microversion: 2.1 time: 0.167156 Aug 29 20:37:09.266837 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 517/1060] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:09 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:10.289446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:10.290150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:10.299807 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:10.303372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:10.303908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:10.307387 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:10.307873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:10.308337 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:10.454928 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:10.462897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e0aa53fc-db63-4195-9efc-6fb3e657d715 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1683 microversion: 2.1 time: 0.178500 Aug 29 20:37:10.463573 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 544/1061] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:10 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:11.489482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:11.490797 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:11.498297 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:11.498801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:11.499231 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:11.499914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:11.500388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:11.500827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:11.789556 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:37:11.789765 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 (ip 10.222.0.85) !!! Aug 29 20:37:11.832714 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:11.843079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-352901af-35fd-412f-9f31-2cabf07710f8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1683 microversion: 2.1 time: 0.362036 Aug 29 20:37:11.844356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 518/1062] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:11 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1683 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:12.067478 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15f73fe-a100-43b8-b9ce-f59456369fa8", "name": "network-vif-deleted", "tag": "bb27e840-7462-4a15-b59d-b2fbd5a8af57"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:12.093922 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.098227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.099099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:12.121083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] Creating event network-vif-deleted:bb27e840-7462-4a15-b59d-b2fbd5a8af57 for instance b15f73fe-a100-43b8-b9ce-f59456369fa8 on hv-cinder-85200 Aug 29 20:37:12.127169 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-98eeb957-44e1-4f0c-90e4-fbfb4be9bc4a req-45ee8b90-3ca7-42c0-ba2d-0fa6ee0426a0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065369 Aug 29 20:37:12.136121 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 545/1063] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:12.866646 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:12.868075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:12.875857 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.876969 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.877860 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:12.878892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.885520 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.886308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:12.932692 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.933514 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.934184 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:12.934839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'fault' on Instance uuid b15f73fe-a100-43b8-b9ce-f59456369fa8 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:37:12.983503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:12.993602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4db7800f-f52c-41b8-866c-6f6eb916ee07 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 200 len: 1332 microversion: 2.1 time: 0.131722 Aug 29 20:37:12.995457 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 519/1064] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:12 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:14.022152 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:14.022755 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:14.029364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.029845 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.030278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.030962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.031408 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.031828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.048529 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 HTTP/1.1 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:37:14.050133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:37:14.051688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'b15f73fe-a100-43b8-b9ce-f59456369fa8'} Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:37:14.052641 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:37:14.054118 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:37:14.056648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:37:14.056648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2b729ded-012c-49bf-a628-30eec6dfaa05 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 404 len: 111 microversion: 2.1 time: 0.034342 Aug 29 20:37:14.056648 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 546/1065] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:14 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:37:14.061134 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-9e7941ae-0835-43a9-8576-c53150bfa2ad tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '.version_select at 0x7f89875bf700>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:14.145831 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-9e7941ae-0835-43a9-8576-c53150bfa2ad tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286761508" status: 202 len: 0 microversion: 2.1 time: 0.088443 Aug 29 20:37:14.146440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 520/1066] 10.222.0.85 () {58 vars in 1221 bytes} [Mon Aug 29 20:37:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286761508 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:37:14.976000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9d44275a-e23e-46ff-bf56-534a0bb6b3db tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: .version_select at 0x7f89879f9d30>, body: {"keypair": {"name": "tempest-keypair-657641220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY3unF46/PDN7neGYw9d/nvtybG8dXA37KTrNAQ28tRgavtKN3DDNxLNZ+IOjUKaQxdoHCGDFyatvUkB2cnZrFN9QXpjke6/zNPVNDAHUptMVruRfLCOmE1Nh2Y7DxacQ=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:14.991856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-9d44275a-e23e-46ff-bf56-534a0bb6b3db tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:37:14.998493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-9d44275a-e23e-46ff-bf56-534a0bb6b3db tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:37:15.116274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9d44275a-e23e-46ff-bf56-534a0bb6b3db tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144573 Aug 29 20:37:15.116888 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 547/1067] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:37:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:17.629146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-418851150", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e83db8-f1ae-4fb9-8271-926f248d148a"}], "security_groups": [{"name": "tempest-securitygroup--1305725203"}], "key_name": "tempest-keypair-657641220", "user_data": "}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:17.732033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] validate_networks() for [('f1e83db8-f1ae-4fb9-8271-926f248d148a', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:37:18.114529 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:37:18.115463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:37:18.115928 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:37:18.116391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:37:18.116826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:37:18.125550 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:18.126018 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:18.126441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:18.127150 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:18.127592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:18.128006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:18.145632 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:37:18.149902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Getting quotas for user 75a2f770cc774d61baa6c07532665477 and project f7b499be5a424f8a860c6e30a060d941. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:37:18.161195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:37:18.163410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:37:18.342082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-299e6534-8c63-4588-ad3b-b8f9e6aa3f83 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717438 Aug 29 20:37:18.342730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 521/1068] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:37:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:37:18.354122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e557600-934a-4449-bbdb-f11c1e3d7201 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:18.354731 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e557600-934a-4449-bbdb-f11c1e3d7201 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:18.412840 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4e557600-934a-4449-bbdb-f11c1e3d7201 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:18.423364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e557600-934a-4449-bbdb-f11c1e3d7201 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1240 microversion: 2.1 time: 0.071634 Aug 29 20:37:18.423364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 548/1069] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:18 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:19.443674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:19.444370 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:19.450630 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.451252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.451681 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.452402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.452852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.453285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.515203 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:19.523547 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0411d36e-8345-444a-b538-a0efa90ced1f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1244 microversion: 2.1 time: 0.084163 Aug 29 20:37:19.524145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 522/1070] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:19 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:20.544214 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:20.544818 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:20.551595 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.552076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.552536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:20.553258 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.554243 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.554661 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:20.634514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:20.643364 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c4bdc31a-746a-4e0c-9750-5b9d3d829a62 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1292 microversion: 2.1 time: 0.102953 Aug 29 20:37:20.644079 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 549/1071] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:20 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:21.665980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:21.666808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:21.675251 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.676069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.676595 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.677389 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.677846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.678260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.933954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.941641 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-babbfb14-ad26-48b3-9cc1-18a72526235e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.280386 Aug 29 20:37:21.942216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 523/1072] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:21 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:22.773507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd500f8b-e2f8-47d1-83e1-7705502f36e5", "tag": "8f9a8f10-ecb2-4e53-810c-811a3a89ea5e"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:22.783280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.783756 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.784194 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.795074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] Creating event network-changed:8f9a8f10-ecb2-4e53-810c-811a3a89ea5e for instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 on hv-cinder-85200 Aug 29 20:37:22.799863 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-aab825f9-01d5-4d16-ab07-30f4b1a98ad8 req-7d4b9868-26b7-44b0-90ea-2459d785bca1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030409 Aug 29 20:37:22.800712 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 550/1073] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:22.962872 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:22.963535 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:22.970174 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.970657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.971125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.971818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.972296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.972723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:23.183241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:23.192299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d37a2508-9a33-43ad-8d4c-99ac1c7fae1a tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.233294 Aug 29 20:37:23.192876 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 524/1074] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:22 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:24.214370 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:24.215076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:24.221227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.221702 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.222127 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.222828 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.223274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.223695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.542519 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.551217 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dd786afe-293f-479e-9973-54fe8adbf3ee tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.341862 Aug 29 20:37:24.551801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 551/1075] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:24 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:25.572694 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:25.573301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:25.579609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.580095 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.580581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.581282 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.581740 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.582219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.720583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.728877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-78093ca1-3646-48a3-b84c-4fdc8e967372 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.160290 Aug 29 20:37:25.729438 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 525/1076] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:25 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:26.757479 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:26.758122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:26.764606 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.765104 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.765532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.766203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.766645 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.767060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.891868 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:26.899753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-14b6eaf2-0584-4e68-877e-34ec0613a740 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.146220 Aug 29 20:37:26.900332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 552/1077] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:26 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:27.562149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd500f8b-e2f8-47d1-83e1-7705502f36e5", "name": "network-vif-plugged", "status": "completed", "tag": "8f9a8f10-ecb2-4e53-810c-811a3a89ea5e"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:27.572939 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.573419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.573851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.584785 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] Creating event network-vif-plugged:8f9a8f10-ecb2-4e53-810c-811a3a89ea5e for instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 on hv-cinder-85200 Aug 29 20:37:27.589960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-84be2e07-54c2-4a58-809f-fc2d2bd1333f req-d1e35550-0537-4068-baeb-fcb66224f758 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Aug 29 20:37:27.590591 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 526/1078] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:27.921493 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:27.922203 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:27.930385 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.931027 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.931501 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.932331 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.932847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.933289 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.068532 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:28.076860 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9831192e-52e2-4a90-ba25-fd16e7e39cc1 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.159972 Aug 29 20:37:28.077464 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 553/1079] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:27 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:29.099069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:29.099808 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:29.102472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:29.103197 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:29.108505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:29.109047 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:29.109482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:29.110163 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:29.110614 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:29.111034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:29.246137 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:29.253699 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8a4fd7b2-3779-492f-9a16-7e90614dd7d6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1366 microversion: 2.1 time: 0.158846 Aug 29 20:37:29.254272 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 527/1080] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:29 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:30.276124 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:30.277156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:30.279330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=6 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:30.285489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.286018 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.286461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.287237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.287700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.288128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.416038 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:30.423988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-11f2cfe6-6a5f-4ff7-8800-12f3f1f56af2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1557 microversion: 2.1 time: 0.152911 Aug 29 20:37:30.424601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 554/1081] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:30 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:30.444930 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:30.446071 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:30.458675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.458675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.458675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.458675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.459044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.459044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.539755 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f34f79b6-a4a7-494c-8a66-7987c7dd9b46 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098622 Aug 29 20:37:30.540416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 528/1082] 10.222.0.85 () {58 vars in 1275 bytes} [Mon Aug 29 20:37:30 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:31.735339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd500f8b-e2f8-47d1-83e1-7705502f36e5", "tag": "8f9a8f10-ecb2-4e53-810c-811a3a89ea5e"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:31.745695 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:31.746167 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:31.746609 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:31.759987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] Creating event network-changed:8f9a8f10-ecb2-4e53-810c-811a3a89ea5e for instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 on hv-cinder-85200 Aug 29 20:37:31.765697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-55895aa2-7cf8-4149-b547-81bf211663b1 req-503f16e7-593d-4010-abb0-59a10dc5ffa3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174506 Aug 29 20:37:31.766300 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 555/1083] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:08.006061 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:08.006818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=76 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:08.010743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:08.011237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:08.017445 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:08.017933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:08.018375 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:08.019066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:08.019525 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:08.019952 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:08.045677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f184e7a1-83ab-44a3-9fd4-5c9661a7875f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/ips" status: 200 len: 151 microversion: 2.1 time: 0.041718 Aug 29 20:38:08.046270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 529/1084] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:38:08 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:11.948647 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f39fa13-e0bb-44d2-a0f8-41d616a08c94"}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:11.951783 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:11.953971 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:11.954626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=64,nova_cell1:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:11.959976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:11.960510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:11.960946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:11.966181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:11.966181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:11.966181 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:12.884873 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-717b6ed8-cd81-498d-b083-a010fc5e949e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "POST /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940573 Aug 29 20:38:12.885401 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 556/1085] 10.222.0.85 () {60 vars in 1323 bytes} [Mon Aug 29 20:38:11 2022] POST /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:38:20.516829 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:20.517348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:20.525259 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.525723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.526158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.526841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.527291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.527744 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.608503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'services' on Instance uuid fd500f8b-e2f8-47d1-83e1-7705502f36e5 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:20.958826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e183fc33-3eab-4fa4-97cb-7093d4607d93 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments/4f39fa13-e0bb-44d2-a0f8-41d616a08c94" status: 202 len: 0 microversion: 2.1 time: 0.446111 Aug 29 20:38:20.959492 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 530/1086] 10.222.0.85 () {58 vars in 1416 bytes} [Mon Aug 29 20:38:20 2022] DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments/4f39fa13-e0bb-44d2-a0f8-41d616a08c94 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:20.969372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:20.971690 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:20.978062 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.978551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.978989 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.979799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.980280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.981254 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:21.010791 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-de993a34-9ac4-498c-96e2-cf72d9b20dc8 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046675 Aug 29 20:38:21.016600 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 557/1087] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:20 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:22.030278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:22.034067 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:22.040401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:22.040879 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:22.041312 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:22.042245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:22.042698 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:22.043143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:22.076902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e3825967-aa04-4728-809c-25159e052530 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054364 Aug 29 20:38:22.077461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 531/1088] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:22 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:23.088638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:23.091735 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:23.098279 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.098762 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.099205 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.099890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.100383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.100810 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.129579 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-16918924-8146-4195-ba5a-e854af2fb3e6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044907 Aug 29 20:38:23.130146 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 558/1089] 10.222.0.85 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:23 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:38:23.190459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:23.190972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:23.197365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.197845 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.198280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.198965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.199467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.199892 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.225065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:23.715143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f6751ede-80b4-41ff-bdcf-1d6f004d715f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 204 len: 0 microversion: 2.1 time: 0.528302 Aug 29 20:38:23.715742 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 532/1090] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:23 2022] DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:38:23.723826 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:23.724539 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:23.730964 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.731446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.731881 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.732607 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.733061 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.733489 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.864601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:23.872280 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e8972f82-964b-4ddb-89a8-2128892fca41 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1682 microversion: 2.1 time: 0.152313 Aug 29 20:38:23.872846 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 559/1091] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:23 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:24.894464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:24.895074 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:24.901713 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:24.902189 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:24.902619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:24.903296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:24.903740 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:24.904158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:25.036572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:25.044651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-874a8fcf-ab53-4a4d-825e-d13823b45def tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1682 microversion: 2.1 time: 0.154615 Aug 29 20:38:25.045275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 533/1092] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:24 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:26.065963 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:26.066533 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:26.073068 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:26.073560 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:26.073998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:26.074699 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:26.075158 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:26.075584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:26.206216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:26.213925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6f503e52-ca6b-4598-b871-731fb78db1c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1682 microversion: 2.1 time: 0.151967 Aug 29 20:38:26.214490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 560/1093] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:26 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:26.561571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd500f8b-e2f8-47d1-83e1-7705502f36e5", "name": "network-vif-deleted", "tag": "8f9a8f10-ecb2-4e53-810c-811a3a89ea5e"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:26.576338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:26.576338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:26.576338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:26.584685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] Creating event network-vif-deleted:8f9a8f10-ecb2-4e53-810c-811a3a89ea5e for instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 on hv-cinder-85200 Aug 29 20:38:26.590653 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-41d5c1b5-89db-41df-9f28-f6a12e509c69 req-fbaccd2d-76d0-4868-938a-2edd9e381095 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 Aug 29 20:38:26.591295 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 534/1094] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:27.234973 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:27.235527 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:27.241855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:27.242335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:27.242771 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:27.243453 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:27.244093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:27.244687 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:27.275798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:27.276309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:27.276746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:27.277781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lazy-loading 'fault' on Instance uuid fd500f8b-e2f8-47d1-83e1-7705502f36e5 {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:27.319725 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a2f770cc774d61baa6c07532665477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b499be5a424f8a860c6e30a060d941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:27.328577 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9a2d67e9-e647-4ea7-8f4e-396166109cf6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 200 len: 1330 microversion: 2.1 time: 0.097540 Aug 29 20:38:27.329157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 561/1095] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:27 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:28.351410 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:28.352100 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:28.358285 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:28.358763 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:28.359191 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:28.359864 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:28.360349 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:28.360770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:28.374416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 HTTP/1.1 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:28.376042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:28.377622 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'fd500f8b-e2f8-47d1-83e1-7705502f36e5'} Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:28.378501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:28.380085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:28.381604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:28.381604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-fd2afdca-1a68-4990-b1b0-9591b38bd82e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 404 len: 111 microversion: 2.1 time: 0.030730 Aug 29 20:38:28.381604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 535/1096] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:28 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:28.386294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-53db5507-48b6-40ae-86fb-73714a792c3b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '.version_select at 0x7f898880df70>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:28.521553 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-53db5507-48b6-40ae-86fb-73714a792c3b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657641220" status: 202 len: 0 microversion: 2.1 time: 0.139038 Aug 29 20:38:28.523798 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 562/1097] 10.222.0.85 () {58 vars in 1218 bytes} [Mon Aug 29 20:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657641220 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:30.758958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:30.759495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:30.766633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.767114 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.767555 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.768268 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.768720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.769143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.782753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 HTTP/1.1 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:30.784300 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.785934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'fd500f8b-e2f8-47d1-83e1-7705502f36e5'} Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:30.786878 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.788428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.789961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:30.789961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5e60e582-80f7-48e6-85ad-7d60ffad3e81 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 404 len: 111 microversion: 2.1 time: 0.030671 Aug 29 20:38:30.789961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 536/1098] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:30 2022] DELETE /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:30.794496 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:30.795108 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: fd500f8b-e2f8-47d1-83e1-7705502f36e5] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:30.801580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.802063 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.802498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.803184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.803635 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.804060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.819064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 HTTP/1.1 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:30.820700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.822362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'fd500f8b-e2f8-47d1-83e1-7705502f36e5'} Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:30.823482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. Aug 29 20:38:30.825636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:30.827059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance fd500f8b-e2f8-47d1-83e1-7705502f36e5 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:30.827059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b0ae7519-2bfd-4fd6-8904-fd62e18bdaa6 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5" status: 404 len: 111 microversion: 2.1 time: 0.031873 Aug 29 20:38:30.827059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 563/1099] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:30 2022] GET /compute/v2.1/servers/fd500f8b-e2f8-47d1-83e1-7705502f36e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:32.102679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.103181 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.109583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.110062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.110498 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.111187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.111638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.112065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.125807 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 HTTP/1.1 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:32.127324 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.128959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'b15f73fe-a100-43b8-b9ce-f59456369fa8'} Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:32.129981 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.131597 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.133201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:32.133201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-61513926-5590-4981-8248-1c5b8ce231c2 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 404 len: 111 microversion: 2.1 time: 0.029864 Aug 29 20:38:32.133201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 537/1100] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:32 2022] DELETE /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:38:32.139070 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.139700 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: b15f73fe-a100-43b8-b9ce-f59456369fa8] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.146227 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.146751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.147202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.147895 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.148638 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.149056 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.162153 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 HTTP/1.1 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:32.163651 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.165297 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'b15f73fe-a100-43b8-b9ce-f59456369fa8'} Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:32.166402 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. Aug 29 20:38:32.167919 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.170081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance b15f73fe-a100-43b8-b9ce-f59456369fa8 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:32.170081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d716ae7f-5c37-4e11-bd55-1c46e7360d17 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8" status: 404 len: 111 microversion: 2.1 time: 0.030461 Aug 29 20:38:32.170081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 564/1101] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:32 2022] GET /compute/v2.1/servers/b15f73fe-a100-43b8-b9ce-f59456369fa8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:32.173411 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.173903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.179774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.180317 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.180754 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.181434 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.181889 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.182310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.196020 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 HTTP/1.1 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:32.197564 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.199801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '969e255f-8170-47dd-a4ce-ef610d035370'} Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:32.200859 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.202384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.203933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:32.203933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0f414557-0164-4bdc-a810-642b79c5508f tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 404 len: 111 microversion: 2.1 time: 0.029442 Aug 29 20:38:32.203933 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 538/1102] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:32 2022] DELETE /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:32.209117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.209730 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 969e255f-8170-47dd-a4ce-ef610d035370] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.215601 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.216086 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.216569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.217256 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.217714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.218144 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.231263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 HTTP/1.1 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:32.232790 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.234419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '969e255f-8170-47dd-a4ce-ef610d035370'} Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:32.235715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. Aug 29 20:38:32.237239 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:32.238599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 969e255f-8170-47dd-a4ce-ef610d035370 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:32.238599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-fc061037-0d27-46fe-9c53-c6526d64a488 tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370" status: 404 len: 111 microversion: 2.1 time: 0.028871 Aug 29 20:38:32.238599 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 565/1103] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:32 2022] GET /compute/v2.1/servers/969e255f-8170-47dd-a4ce-ef610d035370 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:33.572125 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:33.572652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:33.579000 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.579483 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.579921 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.580667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.581122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.581549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.595359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a HTTP/1.1 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:33.596910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.598364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a'} Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:33.599931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.601252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.602619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:33.602619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-503ab2a0-efdd-47ee-b9ab-271a28dd734e tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 404 len: 111 microversion: 2.1 time: 0.030136 Aug 29 20:38:33.602619 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 539/1104] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:33 2022] DELETE /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:33.607848 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:33.609191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] [instance: 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:33.615992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.618202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.618202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.618202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.618202 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.618646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.632327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] HTTP exception thrown: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Request method failure captured: Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a HTTP/1.1 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSKZQLfZ8ggvTKrURzt7OKUZGWdhsUDMM2plFeq1MOj_HoZfbQHpJtPJiBY5XP1E8-Hgp8jv2lY0wSNx_swagIYOR9oCYVC0Wq5_9pj2mwMkyn-jl400qkNZJ89AqYNCMsS9BUM-VSdWSVD5SaJaoLNK6337cT_1OlQ0BOdGPmWbavs Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:33.633942 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7b499be5a424f8a860c6e30a060d941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7b499be5a424f8a860c6e30a060d941", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: f7b499be5a424f8a860c6e30a060d941 Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-464308336 Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 75a2f770cc774d61baa6c07532665477 Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-AttachVolumeNegativeTest-464308336-project Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.635709 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a'} Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:33.636722 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. Aug 29 20:38:33.638232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:33.639614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] Returning 404 to user: Instance 2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:33.639614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6b677d60-b81e-420e-8e5d-6fc51f43fd7b tempest-AttachVolumeNegativeTest-464308336 tempest-AttachVolumeNegativeTest-464308336-project] 10.222.0.85 "GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a" status: 404 len: 111 microversion: 2.1 time: 0.032161 Aug 29 20:38:33.639614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 566/1105] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:33 2022] GET /compute/v2.1/servers/2b0f295d-dac4-470d-a0a4-fe9a55f9bc0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:39.113652 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a8449f1f-1707-4225-beef-17b2b7f55dfb tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Action: 'create', calling method: .version_select at 0x7f898792ba60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2003882810", "metadata": {"Type": "work"}}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a8449f1f-1707-4225-beef-17b2b7f55dfb tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 122 Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:39.277906 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2003882810", "metadata": {"Type": "work"}}} Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: Aug 29 20:38:39.279558 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2003882810', 'metadata': {'Type': 'work'}}}} Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.280631 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:38:39.282342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:38:39.283799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:38:39.283799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.283799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a8449f1f-1707-4225-beef-17b2b7f55dfb tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.283799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a8449f1f-1707-4225-beef-17b2b7f55dfb tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.252234 Aug 29 20:38:39.283799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 540/1106] 10.222.0.85 () {60 vars in 1156 bytes} [Mon Aug 29 20:38:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:38:39.286154 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-672c17e5-8e8a-41d2-b43e-53ee3297ecd3 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Action: 'create', calling method: .version_select at 0x7f89878ef790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1504225803", "metadata": {"Type": "work"}}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-672c17e5-8e8a-41d2-b43e-53ee3297ecd3 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 120 Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:39.290864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1504225803", "metadata": {"Type": "work"}}} Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:38:39.292498 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1504225803', 'metadata': {'Type': 'work'}}}} Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi '0' Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.293654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:38:39.295294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:38:39.296880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:38:39.296880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.296880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-672c17e5-8e8a-41d2-b43e-53ee3297ecd3 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.296880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-672c17e5-8e8a-41d2-b43e-53ee3297ecd3 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010151 Aug 29 20:38:39.296880 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 567/1107] 10.222.0.85 () {60 vars in 1156 bytes} [Mon Aug 29 20:38:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:38:39.301420 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-211aebe0-7348-49fd-96bd-543e656d0b23 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Action: 'create', calling method: .version_select at 0x7f89875bf8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615193066", "metadata": {"Type": "work"}}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-211aebe0-7348-49fd-96bd-543e656d0b23 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 118 Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:39.306168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615193066", "metadata": {"Type": "work"}}} Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: Aug 29 20:38:39.307758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-615193066', 'metadata': {'Type': 'work'}}}} Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi '' Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.308929 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:38:39.310623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:38:39.312077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:38:39.312077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.312077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-211aebe0-7348-49fd-96bd-543e656d0b23 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.312077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-211aebe0-7348-49fd-96bd-543e656d0b23 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009915 Aug 29 20:38:39.312077 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 541/1108] 10.222.0.85 () {60 vars in 1156 bytes} [Mon Aug 29 20:38:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:38:39.317289 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2351a1c3-486c-4742-bd5e-30a92bdca5d2 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Calling method '.version_select at 0x7f89879f9d30>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.346855 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-2351a1c3-486c-4742-bd5e-30a92bdca5d2 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] HTTP exception thrown: Volume tempest-invalid-920747072 could not be found. Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2351a1c3-486c-4742-bd5e-30a92bdca5d2 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-920747072 HTTP/1.1 Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:39.348960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Volume tempest-invalid-920747072 could not be found. Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'tempest-invalid-920747072'} Aug 29 20:38:39.365294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-920747072 could not be found. (HTTP 404) (Request-ID: req-a11d91bb-0a2b-43dd-8a8c-4af234fd9805) Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.366349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:38:39.367879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-920747072 could not be found. Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:39.369440 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-920747072 could not be found. Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-920747072 could not be found. Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2351a1c3-486c-4742-bd5e-30a92bdca5d2 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 404 to user: Volume tempest-invalid-920747072 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2351a1c3-486c-4742-bd5e-30a92bdca5d2 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-920747072" status: 404 len: 98 microversion: 2.1 time: 0.037308 Aug 29 20:38:39.371001 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 568/1109] 10.222.0.85 () {58 vars in 1215 bytes} [Mon Aug 29 20:38:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-920747072 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:38:39.372013 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3e9e264e-e0f5-495c-bdb5-c5016cc7b242 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003775 Aug 29 20:38:39.372113 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 542/1110] 10.222.0.85 () {58 vars in 1140 bytes} [Mon Aug 29 20:38:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 20:38:39.380518 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-73d7675c-2880-45a3-a430-b0dc0b38497a tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003889 Aug 29 20:38:39.381002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 569/1111] 10.222.0.85 () {58 vars in 1137 bytes} [Mon Aug 29 20:38:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:38:39.389424 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-24128415-ca4b-4c0c-8bb1-df1dc136cafa tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Calling method '.version_select at 0x7f898760e1f0>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.418143 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-24128415-ca4b-4c0c-8bb1-df1dc136cafa tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] HTTP exception thrown: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-24128415-ca4b-4c0c-8bb1-df1dc136cafa tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: DELETE /compute/v2.1/os-volumes/03a73caf-4b4a-431e-8d87-00a12b930011 HTTP/1.1 Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:38:39.420248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '03a73caf-4b4a-431e-8d87-00a12b930011'} Aug 29 20:38:39.421823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. (HTTP 404) (Request-ID: req-c456b6fe-415f-49ee-b013-fe045b16a792) Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.422774 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:38:39.424262 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:38:39.425524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-24128415-ca4b-4c0c-8bb1-df1dc136cafa tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 404 to user: Volume 03a73caf-4b4a-431e-8d87-00a12b930011 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-24128415-ca4b-4c0c-8bb1-df1dc136cafa tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/03a73caf-4b4a-431e-8d87-00a12b930011" status: 404 len: 109 microversion: 2.1 time: 0.036206 Aug 29 20:38:39.427200 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 543/1112] 10.222.0.85 () {58 vars in 1248 bytes} [Mon Aug 29 20:38:39 2022] DELETE /compute/v2.1/os-volumes/03a73caf-4b4a-431e-8d87-00a12b930011 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:39.436037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8e964550-2e01-4490-8fe6-ba0029525878 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Calling method '.version_select at 0x7f89878ef3a0>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.460117 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-8e964550-2e01-4490-8fe6-ba0029525878 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] HTTP exception thrown: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8e964550-2e01-4490-8fe6-ba0029525878 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Request method failure captured: Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/os-volumes/3fa4a303-d0e4-49b5-b733-9b394f90e245 HTTP/1.1 Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSPOIwsNvxyrrsD7PANqsZFGfto9qqAx7Puv6OGEG1XKg_dUau_ppLVi4pLsn6MyyNRKhDZVTkaOfHH4mVGiDhYrJHhoasDdQo2302lWfMUjxDA4mBXcOvye6tUHySda_Jt_bDDcxkS5ZWWIi-WtZsVqn5MZoT_-0d0MSdFbFm6S_zU Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:38:39.462069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72eda801bca64d9f91a2a48262a36a1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72eda801bca64d9f91a2a48262a36a1f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: 72eda801bca64d9f91a2a48262a36a1f Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-VolumesNegativeTest-577398635 Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: e5a3df08e75f4861a068bae545e42b45 Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-VolumesNegativeTest-577398635-project Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '3fa4a303-d0e4-49b5-b733-9b394f90e245'} Aug 29 20:38:39.463708 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. (HTTP 404) (Request-ID: req-1ec738e6-71e3-4373-beb4-ca4c7e226208) Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.465418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:38:39.466858 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:38:39.468290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-8e964550-2e01-4490-8fe6-ba0029525878 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] Returning 404 to user: Volume 3fa4a303-d0e4-49b5-b733-9b394f90e245 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-8e964550-2e01-4490-8fe6-ba0029525878 tempest-VolumesNegativeTest-577398635 tempest-VolumesNegativeTest-577398635-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3fa4a303-d0e4-49b5-b733-9b394f90e245" status: 404 len: 109 microversion: 2.1 time: 0.036181 Aug 29 20:38:39.469692 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 570/1113] 10.222.0.85 () {58 vars in 1245 bytes} [Mon Aug 29 20:38:39 2022] GET /compute/v2.1/os-volumes/3fa4a303-d0e4-49b5-b733-9b394f90e245 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:40:17.203323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.204153 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.206012 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 20:40:17.206157 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.85) !!! Aug 29 20:40:17.207697 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:40:17.207833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.85) !!! Aug 29 20:40:17.212721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-361249214", "imageRef": "1c3c36fb-32c2-4133-8132-b0c77bb289f8", "flavorRef": "452"}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:17.268053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] validate_networks() for None {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:40:17.543165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:40:17.543602 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:40:17.544056 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:40:17.544501 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:40:17.544907 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:40:17.553605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:17.554082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:17.554517 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:17.555236 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:17.555689 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:17.556111 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:17.573078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Getting quotas for project 9bab8a45db344c0ea68c26a38b126809. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:40:17.576992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Getting quotas for user 1a9c77cb2e0a4aa19c3cc289b9ffb5e4 and project 9bab8a45db344c0ea68c26a38b126809. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:40:17.588761 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:40:17.591039 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c3c36fb-32c2-4133-8132-b0c77bb289f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:40:17.779484 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-2b5edf94-5eeb-40cb-8dea-dcc9e586a01b tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577903 Aug 29 20:40:17.780046 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 544/1114] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:40:17.789433 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e311dbdd-0370-4166-a740-f50d337f0615] AMQP server on 10.222.0.85:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 20:40:17.791876 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.792748 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.794237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:40:17.794386 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 (ip 10.222.0.85) !!! Aug 29 20:40:17.809892 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d09c58ca-7993-4045-af5f-7b3a2b6f45f6 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:17.810502 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d09c58ca-7993-4045-af5f-7b3a2b6f45f6 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:17.873362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d09c58ca-7993-4045-af5f-7b3a2b6f45f6 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:17.880201 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d09c58ca-7993-4045-af5f-7b3a2b6f45f6 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1214 microversion: 2.1 time: 0.093231 Aug 29 20:40:17.881636 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 571/1115] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:17 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:18.902726 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dea84a3e-bd0f-45cb-9603-1607e0da9cd5 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:18.903340 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dea84a3e-bd0f-45cb-9603-1607e0da9cd5 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:18.955422 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dea84a3e-bd0f-45cb-9603-1607e0da9cd5 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:18.962828 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dea84a3e-bd0f-45cb-9603-1607e0da9cd5 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1214 microversion: 2.1 time: 0.064799 Aug 29 20:40:18.963388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 545/1116] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:18 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:19.984307 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:19.985090 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:19.997510 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:19.998021 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:19.998452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:19.999180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:19.999627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:20.000156 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:20.007773 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] [e311dbdd-0370-4166-a740-f50d337f0615] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 47432. Aug 29 20:40:20.065225 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:20.072750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-efa84b9f-b18c-4c3c-b398-b471c91ddbb0 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1266 microversion: 2.1 time: 0.092628 Aug 29 20:40:20.073311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 572/1117] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:19 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:21.094006 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:21.094592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:21.101871 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:21.102350 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:21.102787 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:21.103587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:21.104034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:21.104489 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:21.170799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:21.178648 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1bf6398b-5750-450b-b5a7-493283756173 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1284 microversion: 2.1 time: 0.088660 Aug 29 20:40:21.179260 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 546/1118] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:21 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:22.199654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:22.200294 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:22.209746 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:22.210332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:22.210770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:22.211531 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:22.211982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:22.212425 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:22.346262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:22.357381 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-78a59338-0430-4dc1-84a6-aa5ebb1ddc74 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.162187 Aug 29 20:40:22.358299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 573/1119] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:22 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:22.908202 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab844d0a-378d-4217-92eb-98b777c28555", "tag": "ba42d2e7-e40d-4cc2-a145-79c56b603f28"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:22.918817 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:22.919301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:22.919739 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:22.930496 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] Creating event network-changed:ba42d2e7-e40d-4cc2-a145-79c56b603f28 for instance ab844d0a-378d-4217-92eb-98b777c28555 on hv-cinder-85200 Aug 29 20:40:22.935895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-5d54d2d2-fe58-46bb-86d4-fd377b2452b0 req-ac2d8994-d77c-403b-8a5a-4130b538ca02 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Aug 29 20:40:22.936533 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 547/1120] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:23.379174 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:23.379800 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:23.386813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:23.387291 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:23.387721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:23.388431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:23.388879 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:23.389293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:23.543911 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:23.551716 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-9ace9db0-14e0-4f25-b682-6671ab45da53 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.176501 Aug 29 20:40:23.552379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 574/1121] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:23 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:24.574644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:24.575338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:24.581471 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:24.581954 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:24.582392 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:24.583076 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:24.583572 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:24.583999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:24.715603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:24.723237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4c31316b-8407-4edd-bd8c-7ed13124c074 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.153628 Aug 29 20:40:24.723796 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 548/1122] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:24 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:40:25.744634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:25.745264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:25.751926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:25.752524 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:25.753077 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:25.753890 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:25.754356 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:25.754813 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:25.884380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:25.892035 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ed303476-6468-4d35-bbf7-3ecad9a597cf tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.151218 Aug 29 20:40:25.892627 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 575/1123] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:25 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:26.913261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:26.913902 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:26.920475 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:26.920961 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:26.921401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:26.922088 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:26.922540 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:26.922965 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:27.049196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:27.056825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-11996488-d193-46a4-8969-4c312eec5610 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.147689 Aug 29 20:40:27.057400 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 549/1124] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:26 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:28.077941 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:28.078552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:28.080961 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:28.086442 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:28.086925 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:28.087374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:28.088047 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:28.088541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:28.088966 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:28.237642 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:28.245429 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b23f64ae-b8a6-4b33-8ae8-43c7af1d496c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.171758 Aug 29 20:40:28.245996 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 576/1125] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:28 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:28.390959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:28.514566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab844d0a-378d-4217-92eb-98b777c28555", "name": "network-vif-plugged", "status": "completed", "tag": "ba42d2e7-e40d-4cc2-a145-79c56b603f28"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:28.524365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:28.524833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:28.525253 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:28.536358 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] Creating event network-vif-plugged:ba42d2e7-e40d-4cc2-a145-79c56b603f28 for instance ab844d0a-378d-4217-92eb-98b777c28555 on hv-cinder-85200 Aug 29 20:40:28.541503 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-822782da-20a9-4d4b-83cf-22a2029d88c6 req-845f99ce-3538-4c35-bab4-9a77227f2266 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155089 Aug 29 20:40:28.542098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 550/1126] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:29.267051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:29.267634 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:29.274842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:29.279507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:29.279507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:29.279507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:29.279507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:29.279932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:29.416452 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:29.424373 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-06baf8eb-0503-4de4-b77a-6e2d759df2dd tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.161246 Aug 29 20:40:29.424959 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 577/1127] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:29 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:30.442979 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=8 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:30.447620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:30.448356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:30.454428 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:30.454914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:30.455352 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:30.456051 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:30.456532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:30.456957 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:30.593017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:30.601195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4534a879-4581-453a-8a8a-038cd510530f tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1314 microversion: 2.1 time: 0.159206 Aug 29 20:40:30.601812 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 551/1128] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:30 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:31.622013 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:31.622623 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:31.629339 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.629822 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.630296 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.630976 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.631431 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.631850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.758503 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:31.766016 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dcdb08bc-d4f1-42e7-b5a1-05fe07ca8482 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1463 microversion: 2.1 time: 0.147915 Aug 29 20:40:31.766576 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 578/1129] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:31 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:31.809980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:31.810472 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:31.816881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.817359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.818293 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.818972 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.819425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.819848 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.844839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:40:32.179313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-31c63b9b-3f64-465c-b879-4b8eda451ef4 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 204 len: 0 microversion: 2.1 time: 0.372875 Aug 29 20:40:32.179890 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 552/1130] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:40:31 2022] DELETE /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:40:32.188002 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:32.188646 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:32.194588 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:32.195073 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:32.195513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:32.196233 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:32.196721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:32.197149 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:32.330092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:32.338284 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b5499ec6-655a-4460-a5ef-6b323ddf45ed tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1469 microversion: 2.1 time: 0.154223 Aug 29 20:40:32.338849 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 579/1131] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:32 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:33.360562 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:33.361293 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:33.368361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:33.368852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:33.369292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:33.369987 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:33.370441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:33.370868 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:33.502743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:33.510998 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8b67c3d6-1cbb-4070-82b8-8b70a4b59f4c tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1469 microversion: 2.1 time: 0.154840 Aug 29 20:40:33.511579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 553/1132] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:33 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:34.254120 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab844d0a-378d-4217-92eb-98b777c28555", "name": "network-vif-deleted", "tag": "ba42d2e7-e40d-4cc2-a145-79c56b603f28"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:34.264037 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.264548 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.265051 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:34.277133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] Creating event network-vif-deleted:ba42d2e7-e40d-4cc2-a145-79c56b603f28 for instance ab844d0a-378d-4217-92eb-98b777c28555 on hv-cinder-85200 Aug 29 20:40:34.280656 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR oslo.messaging._drivers.impl_rabbit [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] [35b79091-5165-4383-8ecd-d8e31b1749ed] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:40:34.538640 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:34.539177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:34.545571 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.546054 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.546594 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:34.547281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.547730 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.548154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:34.612049 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9c77cb2e0a4aa19c3cc289b9ffb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bab8a45db344c0ea68c26a38b126809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:34.620445 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-e2b344c7-8328-4565-8616-3aede428ab31 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 200 len: 1299 microversion: 2.1 time: 0.086401 Aug 29 20:40:34.621245 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 554/1133] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:34 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:40:35.288582 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] [35b79091-5165-4383-8ecd-d8e31b1749ed] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 47486. Aug 29 20:40:35.291903 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-535693dd-a29e-44ce-93b8-26cdf0192985 req-5764f05c-d806-4547-91cd-a61eaf5f42e4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041653 Aug 29 20:40:35.292552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 580/1134] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:35.641092 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:35.641694 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] [instance: ab844d0a-378d-4217-92eb-98b777c28555] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:35.648363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:35.649092 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:35.649518 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:35.650195 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:35.650638 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:35.651102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:35.664275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] HTTP exception thrown: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Request method failure captured: Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 HTTP/1.1 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSQvWVv0jxQjUD9xnUICcgqGt7t736sRAxw1QV_2wHFkk_2THo1_nCyML4GLcLiTncaYkMOJpDewGWg2Fv4fcyfn1HS9J3nBlH-3t7ldNTXvS0UevHFlKmgFWm2O5VA12veymUe8Y6JRoDsRQ2hMfa_Y5helD76SmaHHffQ7aklkZds Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: 9bab8a45db344c0ea68c26a38b126809 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-VolumesNegativeTest-1087976256 Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:40:35.665891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9bab8a45db344c0ea68c26a38b126809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9bab8a45db344c0ea68c26a38b126809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9bab8a45db344c0ea68c26a38b126809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9bab8a45db344c0ea68c26a38b126809", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-VolumesNegativeTest-1087976256 Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: 9bab8a45db344c0ea68c26a38b126809 Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-VolumesNegativeTest-1087976256 Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-VolumesNegativeTest-1087976256-project Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 1a9c77cb2e0a4aa19c3cc289b9ffb5e4 Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-VolumesNegativeTest-1087976256-project Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. Aug 29 20:40:35.667603 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'ab844d0a-378d-4217-92eb-98b777c28555'} Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:40:35.668672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. Aug 29 20:40:35.670316 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:40:35.671980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] Returning 404 to user: Instance ab844d0a-378d-4217-92eb-98b777c28555 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:40:35.671980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d7377bed-a7c8-44c7-b42d-6c895d340a25 tempest-VolumesNegativeTest-1087976256 tempest-VolumesNegativeTest-1087976256-project] 10.222.0.85 "GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555" status: 404 len: 111 microversion: 2.1 time: 0.030190 Aug 29 20:40:35.671980 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 555/1135] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:35 2022] GET /compute/v2.1/servers/ab844d0a-378d-4217-92eb-98b777c28555 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:40:55.508867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=22 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:55.509626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=50 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:55.726058 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ffd0f5f4-9e03-49a0-8d57-7d437efc6f23 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Action: 'create', calling method: .version_select at 0x7f89878ef4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-247028261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK0Qo8mVhskor6gy6UchPlO55nDlFtwvstLvilBojnRvQgRVV16Iw1wEsHd+Ozumr3ADxyQcAsRCHT27m2V/LjBtKnx7mJb13ofp7CwJpfj5osAJXYPsG0l96R2QsRkfA=="}} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:55.741913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-ffd0f5f4-9e03-49a0-8d57-7d437efc6f23 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for project a55662f8acc54509b089b401af78ea9b. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:40:55.749341 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.quota [None req-ffd0f5f4-9e03-49a0-8d57-7d437efc6f23 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for user 1d30c32e7ee441a38cdd67660fc81cd2 and project a55662f8acc54509b089b401af78ea9b. Resources: {'key_pairs'} {{(pid=121467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:40:55.867406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ffd0f5f4-9e03-49a0-8d57-7d437efc6f23 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.360065 Aug 29 20:40:55.868122 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 581/1136] 10.222.0.85 () {60 vars in 1159 bytes} [Mon Aug 29 20:40:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:14.259237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1252938761", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-247028261", "security_groups": [{"name": "tempest-secgroup-smoke-262447371"}], "block_device_mapping_v2": [{"uuid": "3038ba29-ce36-4b55-b41c-c0b7f2fbb1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af404a73-34f9-4bde-b0c8-4d7dda0a390d"}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:14.269545 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:14.270199 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:14.373819 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] validate_networks() for [('af404a73-34f9-4bde-b0c8-4d7dda0a390d', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:41:14.842583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:41:14.843004 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:41:14.843477 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:41:14.843881 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:41:14.844326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:41:14.852912 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:14.853391 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:14.853823 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:14.854544 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:14.854992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:14.855413 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:14.873062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:41:14.876976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for user 1d30c32e7ee441a38cdd67660fc81cd2 and project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:41:14.933186 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:41:14.935281 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3038ba29-ce36-4b55-b41c-c0b7f2fbb1ec',volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:41:15.418292 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-3f6ac262-eb23-4be2-ae93-594939bbceae tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162657 Aug 29 20:41:15.419273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 556/1137] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:41:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:41:15.429787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-88bdbc46-eea9-48a7-889f-091b96252171 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:15.430704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-88bdbc46-eea9-48a7-889f-091b96252171 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:15.433777 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=4 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:15.435170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:15.490329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-88bdbc46-eea9-48a7-889f-091b96252171 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:15.497765 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-88bdbc46-eea9-48a7-889f-091b96252171 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1094 microversion: 2.1 time: 0.071933 Aug 29 20:41:15.498333 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 582/1138] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:15 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:16.519365 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:16.519916 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:16.528275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:16.529029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:16.529720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:16.530500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:16.530986 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:16.531482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:16.594507 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:16.602120 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1227bafb-81b1-4774-9a26-3b38bd0e1d5f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1144 microversion: 2.1 time: 0.087609 Aug 29 20:41:16.603250 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 557/1139] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:16 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:17.623625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:17.624283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:17.633092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:17.633583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:17.634022 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:17.634714 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:17.635171 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:17.635596 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:17.703793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:17.711472 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-1840138c-49ae-46f3-841f-98b479c6e012 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1192 microversion: 2.1 time: 0.091865 Aug 29 20:41:17.712039 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 583/1140] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:17 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:18.732196 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:18.732851 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:18.739315 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:18.739795 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:18.740257 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:18.740938 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:18.741390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:18.741814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:18.972215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:18.980865 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d7d590af-26e7-4ef6-a1eb-b04581a0fcaf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1277 microversion: 2.1 time: 0.252550 Aug 29 20:41:18.984736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 558/1141] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:18 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:19.958240 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6423280-5be4-4cfd-8620-a0845146b181", "tag": "c3a44175-9c91-4bcd-b61b-358c49548259"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:19.968616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.969092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.969521 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.981107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] Creating event network-changed:c3a44175-9c91-4bcd-b61b-358c49548259 for instance f6423280-5be4-4cfd-8620-a0845146b181 on hv-cinder-85200 Aug 29 20:41:19.986374 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-96fde4d2-71f2-4842-9fa3-a4f5efd489d2 req-f8ac63ee-8e30-4b38-b215-bdb682cf9fab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031844 Aug 29 20:41:19.987173 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 584/1142] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:20.003609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:20.005246 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:20.019662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:20.019662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:20.019662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:20.019662 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:20.020087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:20.020087 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:20.240922 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:20.249127 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d6257ef1-6dd2-42f2-a05b-c9aaf19da4cd tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1277 microversion: 2.1 time: 0.249908 Aug 29 20:41:20.249891 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 559/1143] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:19 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:21.271495 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:21.272207 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:21.279436 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:21.279918 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:21.280400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:21.281084 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:21.281536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:21.281960 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:21.417515 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:21.425396 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a904d672-ccec-4290-b9ab-eea0146aff55 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.158761 Aug 29 20:41:21.425962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 585/1144] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:21 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:22.445633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:22.446239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:22.452704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:22.453188 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:22.453623 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:22.454308 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:22.454760 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:22.455183 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:22.587549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:22.595519 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c9885ae9-cca5-45d8-8559-fb1458e01d9c tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.153693 Aug 29 20:41:22.596099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 560/1145] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:22 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:23.617514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:23.618124 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:23.626074 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:23.626593 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:23.627064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:23.627767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:23.628269 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:23.628715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:23.759097 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:23.766843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c2136a46-6dbb-4ea8-9a4f-968128d1544d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.154088 Aug 29 20:41:23.767398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 586/1146] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:23 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:24.788090 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:24.788711 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:24.795142 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:24.795628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:24.796066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:24.796784 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:24.797237 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:24.797663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:24.863463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:24.882949 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:24.927360 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:24.936208 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-972fcfe2-d757-43f9-ad7f-1cb9d388deb2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.151995 Aug 29 20:41:24.936791 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 561/1147] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:24 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:25.957355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:25.958082 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:25.965241 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:25.965724 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:25.966161 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:25.966846 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:25.967303 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:25.967727 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:26.096419 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:26.104236 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-85b879ec-fa87-41be-ada3-ee52ffa24773 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.150724 Aug 29 20:41:26.106851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 587/1148] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:25 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:27.125670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:27.126277 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:27.133031 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:27.133513 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:27.133953 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:27.134642 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:27.135097 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:27.135526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:27.261337 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:27.268992 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-398491eb-89c0-4eef-a92b-2b4b2099165e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.147180 Aug 29 20:41:27.269560 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 562/1149] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:27 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:28.289958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:28.291176 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:28.293531 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:28.298263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:28.298750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:28.299188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:28.299877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:28.300367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:28.300797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:28.432052 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:28.439793 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-0298fbf5-4da2-4a92-8036-5d42a630e4e0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.153732 Aug 29 20:41:28.440384 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 588/1150] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:28 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:29.460463 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:29.461182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:29.468576 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:29.469069 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:29.469510 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:29.470206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:29.470665 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:29.471093 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:29.608679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:29.617139 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-4ba4eae0-54fb-4b01-9cb0-2619fc0053ac tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.160553 Aug 29 20:41:29.617721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 563/1151] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:29 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:30.638076 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:30.638808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:30.645293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.645769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.646199 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.646874 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.647318 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.647758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.778814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:30.786416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-6e4c0b11-b290-464b-af4a-4faf24423ff4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.152297 Aug 29 20:41:30.786982 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 589/1152] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:30 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:31.806296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:31.806934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:31.813359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:31.813839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:31.814273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:31.814959 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:31.815412 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:31.815858 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:31.947363 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:31.955066 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1ba6f0f4-22cb-4e13-ae2c-ebe163f205fb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.152679 Aug 29 20:41:31.955663 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 564/1153] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:31 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:32.667885 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6423280-5be4-4cfd-8620-a0845146b181", "name": "network-vif-plugged", "status": "completed", "tag": "c3a44175-9c91-4bcd-b61b-358c49548259"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:32.677755 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:32.678190 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:32.678610 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:32.691927 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] Creating event network-vif-plugged:c3a44175-9c91-4bcd-b61b-358c49548259 for instance f6423280-5be4-4cfd-8620-a0845146b181 on hv-cinder-85200 Aug 29 20:41:32.696930 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-5bc2003a-99ba-4efb-88cc-1ad7f3bf2ee7 req-24d7f731-b852-425f-bda3-ff9f0103e572 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032825 Aug 29 20:41:32.697447 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 590/1154] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:32.976384 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:32.976946 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:32.983830 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:32.984348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:32.984777 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:32.985455 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:32.985899 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:32.986319 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:33.121244 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:33.129042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-55b83858-04a7-4a43-96d2-9b7004db7e2e tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.156648 Aug 29 20:41:33.129604 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 565/1155] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:32 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:34.151321 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:34.152009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:34.158398 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:34.158877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:34.159302 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:34.159984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:34.160480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:34.160897 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:34.483571 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:34.491278 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-5753026b-8327-499f-b991-d7fe744763a2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1265 microversion: 2.1 time: 0.344957 Aug 29 20:41:34.491844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 591/1156] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:34 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:35.511664 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:35.512236 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:35.518427 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:35.518905 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:35.519338 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:35.520019 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:35.520504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:35.520927 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:35.651643 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:35.659321 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c42d418b-1b8c-44b9-aa20-84bfb4b4085a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1453 microversion: 2.1 time: 0.151612 Aug 29 20:41:35.659914 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 566/1157] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:35 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:35.679680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:35.680330 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:35.686843 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:35.687327 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:35.687763 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:35.688477 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:35.688926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:35.689351 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:35.817264 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:35.825729 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a48d3de9-173a-4029-af4e-f714fe9ad95b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1453 microversion: 2.1 time: 0.149915 Aug 29 20:41:35.826295 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 592/1158] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:35 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:37.922178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6423280-5be4-4cfd-8620-a0845146b181", "tag": "c3a44175-9c91-4bcd-b61b-358c49548259"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:37.931913 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:37.932515 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:37.933017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:37.943939 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] Creating event network-changed:c3a44175-9c91-4bcd-b61b-358c49548259 for instance f6423280-5be4-4cfd-8620-a0845146b181 on hv-cinder-85200 Aug 29 20:41:37.949976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-29941f9c-3183-4ffc-9a40-c96698f0850b req-eb8fbaea-62be-410c-a0d7-85bab4f51491 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031082 Aug 29 20:41:37.950658 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 567/1159] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:32.937670 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=24 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:32.938540 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=52 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:32.939781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 20:43:32.939933 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 (ip 10.222.0.85) !!! Aug 29 20:43:32.941809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 20:43:32.941938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 (ip 10.222.0.85) !!! Aug 29 20:43:32.947097 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:32.947594 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:32.957778 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:32.958329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:32.958768 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:32.959461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:32.959917 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:32.960377 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:32.986069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:43:33.375625 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a23b2d80-d5eb-402c-8fc8-05d912b9fa69 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 204 len: 0 microversion: 2.1 time: 0.439580 Aug 29 20:43:33.376235 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 593/1160] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:43:32 2022] DELETE /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:43:33.383159 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:33.383895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=64 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:33.385135 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 20:43:33.385280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 (ip 10.222.0.85) !!! Aug 29 20:43:33.387176 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 20:43:33.387296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 (ip 10.222.0.85) !!! Aug 29 20:43:33.392409 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:33.393102 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:33.404220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:33.404716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:33.405149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:33.405846 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:33.406303 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:33.406728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:33.593579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:33.601439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-08fce407-1d94-4a50-9ba4-290e97a82175 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1578 microversion: 2.1 time: 0.220282 Aug 29 20:43:33.602017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 568/1161] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:33 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:34.623814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:34.624544 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:34.631939 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:34.632471 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:34.632908 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:34.633592 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:34.634046 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:34.634470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:34.823672 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:34.831626 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ec4e375c-9c24-43e0-a36c-e6e788cffb6b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1578 microversion: 2.1 time: 0.212276 Aug 29 20:43:34.832309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 594/1162] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:34 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:35.853579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:35.854313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:35.856825 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15b805b6-9f75-429b-b2bd-b06e385fe1d2] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 20:43:35.861800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:35.862909 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:35.863332 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:35.864017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:35.864482 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:35.864896 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:36.210116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:36.218270 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b4c6c0db-30ca-465f-a856-4dbbc6e6bac3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1511 microversion: 2.1 time: 0.368629 Aug 29 20:43:36.219215 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 569/1163] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:35 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:36.380360 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6423280-5be4-4cfd-8620-a0845146b181", "name": "network-vif-deleted", "tag": "c3a44175-9c91-4bcd-b61b-358c49548259"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:36.389809 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:36.390290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:36.390753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:36.403183 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] Creating event network-vif-deleted:c3a44175-9c91-4bcd-b61b-358c49548259 for instance f6423280-5be4-4cfd-8620-a0845146b181 on hv-cinder-85200 Aug 29 20:43:36.408157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-09e17507-fbde-4e5d-903f-1caba811c65b req-0b8c1d75-9db0-440a-9c18-75d1dda2799e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085271 Aug 29 20:43:36.408779 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 595/1164] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:37.239687 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:37.240342 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:37.251626 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] [15b805b6-9f75-429b-b2bd-b06e385fe1d2] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 48038. Aug 29 20:43:37.256140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:37.256661 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:37.257098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:37.257801 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:37.258258 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:37.258685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:37.291254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:37.291720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:37.292158 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:37.292628 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lazy-loading 'fault' on Instance uuid f6423280-5be4-4cfd-8620-a0845146b181 {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:43:37.333675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:37.342379 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d1536e03-eeb0-4b7b-a141-5aa5023f4440 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 200 len: 1230 microversion: 2.1 time: 0.107077 Aug 29 20:43:37.342967 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 570/1165] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:37 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:43:38.363859 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:38.364566 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:38.370823 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:38.371313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:38.371754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:38.372470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:38.372926 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:38.373348 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:38.386513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] HTTP exception thrown: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Request method failure captured: Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 HTTP/1.1 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSRRgNrYi_8trHCEGOpSNMZaFZ7_14oQGoBz6_ZzBCs1MxOGoq4ozlWUlfrcd9NQWTDJ5ZQnmV5gtDStaovzLuW-cBmY39lPEyOCto0pkPJzLy1RHU1RhByI67YfGhAOhrWZ9_BjdC18Sa0JBWeMnlwt0vC0a6_eV4rbr8oHBdxst-4 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:43:38.388138 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a55662f8acc54509b089b401af78ea9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-TestVolumeBootPattern-283271432 Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 1d30c32e7ee441a38cdd67660fc81cd2 Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:43:38.389946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'f6423280-5be4-4cfd-8620-a0845146b181'} Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:43:38.390987 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:43:38.392704 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:43:38.394787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Returning 404 to user: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:43:38.394787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a9160607-c9b2-4f69-ae25-104d3f0b5328 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 404 len: 111 microversion: 2.1 time: 0.030396 Aug 29 20:43:38.394787 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 596/1166] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:38 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:43:38.437852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836852177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-247028261", "security_groups": [{"name": "tempest-secgroup-smoke-262447371"}], "block_device_mapping_v2": [{"uuid": "3038ba29-ce36-4b55-b41c-c0b7f2fbb1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af404a73-34f9-4bde-b0c8-4d7dda0a390d"}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:38.550033 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] validate_networks() for [('af404a73-34f9-4bde-b0c8-4d7dda0a390d', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:43:38.916791 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:43:38.917220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:43:38.917712 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:43:38.918116 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:43:38.918524 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:43:38.927390 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:38.927898 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:38.928371 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:38.929096 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:38.929549 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:38.929975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:38.946527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:43:38.950446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for user 1d30c32e7ee441a38cdd67660fc81cd2 and project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:43:39.006505 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:43:39.008723 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3038ba29-ce36-4b55-b41c-c0b7f2fbb1ec',volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:43:39.387433 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-abe49472-af5b-499d-a907-82898a2a57d7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.953406 Aug 29 20:43:39.388089 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 571/1167] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:43:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:43:39.399802 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b641d4b8-651f-4ae8-9418-324e34c6eff2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:39.400480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b641d4b8-651f-4ae8-9418-324e34c6eff2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:39.466267 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b641d4b8-651f-4ae8-9418-324e34c6eff2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:39.476535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b641d4b8-651f-4ae8-9418-324e34c6eff2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1094 microversion: 2.1 time: 0.080774 Aug 29 20:43:39.490952 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 597/1168] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:39 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:40.498280 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:40.499045 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:40.505079 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:40.507587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:40.507587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:40.507587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:40.507587 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:40.508011 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:40.568460 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:40.576177 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-055ec68a-b1ac-4313-9607-b4e1ccfbd1be tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1144 microversion: 2.1 time: 0.082212 Aug 29 20:43:40.576752 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 572/1169] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:40 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:41.597832 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:41.598505 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:41.605509 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:41.605999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:41.606434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:41.607128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:41.607602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:41.608026 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:41.676466 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:41.685188 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b3cd0029-2044-4f14-91c5-1a6e409513b4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1200 microversion: 2.1 time: 0.091873 Aug 29 20:43:41.685958 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 598/1170] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:41 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:42.707423 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:42.708462 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:42.720633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:42.721042 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:42.722154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:42.722931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:42.723364 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:42.723788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:42.967685 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:42.977053 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cd73fb7a-12cd-4594-9742-751f0fa46afa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1277 microversion: 2.1 time: 0.273547 Aug 29 20:43:42.977854 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 573/1171] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:42 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:43.417064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2e9007-9106-46cb-9da9-ace478d5395a", "tag": "347f5a03-1185-4b51-bae3-7e362ad5227a"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:43.427938 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:43.428446 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:43.428877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:43.440100 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] Creating event network-changed:347f5a03-1185-4b51-bae3-7e362ad5227a for instance 3f2e9007-9106-46cb-9da9-ace478d5395a on hv-cinder-85200 Aug 29 20:43:43.446171 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-11bd0ef6-2855-487f-96bf-a1c2d91a0dbd req-e402f674-a5cd-47ca-9608-4ef69a2d6ce0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033449 Aug 29 20:43:43.446788 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 599/1172] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:43:43.998852 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:43.999381 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:44.005826 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:44.006311 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:44.006749 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:44.007432 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:44.007904 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:44.008354 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:44.211838 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:44.219616 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-1a76c1df-a152-49d0-9b22-ec60eb90208f tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.224644 Aug 29 20:43:44.220201 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 574/1173] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:43 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:43:45.242660 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:45.243375 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:45.249592 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:45.250083 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:45.250523 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:45.251210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:45.251667 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:45.252092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:45.382747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:45.390394 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-ccd5a8d8-6858-4b29-aa3c-dcb3b15e0829 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.153033 Aug 29 20:43:45.390965 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 600/1174] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:45 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:46.411154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:46.411767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:46.418255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:46.418728 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:46.419161 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:46.419840 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:46.420323 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:46.420743 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:46.553073 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:46.560810 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-45d9b24b-9153-4b50-ab0d-ea2632614244 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.153508 Aug 29 20:43:46.561377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 575/1175] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:46 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:47.582148 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:47.582697 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:47.589757 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:47.590240 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:47.590675 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:47.591362 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:47.591814 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:47.592277 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:47.722751 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:47.730580 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3eebd175-5edf-4541-8b01-6693a8bf42c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.152453 Aug 29 20:43:47.731157 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 601/1176] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:47 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:48.751204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:48.751741 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:48.758220 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:48.758704 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:48.759138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:48.759822 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:48.760301 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:48.760733 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:48.892651 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:48.897566 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-6a3a9d4d-3bdd-4db4-b02f-cdeaaddb5fb1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.150316 Aug 29 20:43:48.898166 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 576/1177] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:48 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:49.919151 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:49.919764 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:49.922229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:49.927059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:49.928105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:49.928570 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:49.929253 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:49.929703 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:49.930310 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:50.057311 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:50.065081 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a13bad89-3e41-4345-9f26-1fabf59f93f7 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.149961 Aug 29 20:43:50.065644 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 602/1178] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:49 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:51.086188 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:51.086911 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:51.088693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:51.089380 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:51.094758 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:51.095242 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:51.095679 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:51.096402 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:51.097171 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:51.097279 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:51.230239 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:51.236366 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-cf76100b-e586-4df0-b7c2-96fa22340f88 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.154500 Aug 29 20:43:51.236940 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 577/1179] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:51 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:52.256301 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:52.256887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:52.264622 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:52.265109 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:52.265541 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:52.266221 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:52.266689 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:52.267313 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:52.403229 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:52.411261 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4a4ddb30-f4d2-49e9-9b09-628a81a5018a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.158827 Aug 29 20:43:52.411913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 603/1180] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:52 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:53.435543 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:53.436286 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:53.443062 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:53.443542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:53.443975 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:53.444693 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:53.445146 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:53.446154 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:53.578624 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:53.586934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-dc92d38d-db7b-4812-87db-ac1ccc0d33e3 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.155002 Aug 29 20:43:53.587504 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 578/1181] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:53 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:54.609059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:54.610232 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:54.618106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:54.618586 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:54.619012 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:54.619777 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:54.620250 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:54.620669 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:54.751913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:54.760105 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-224540fe-662c-4fc8-9599-a3e9fea618e6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.156345 Aug 29 20:43:54.760682 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 604/1182] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:54 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:55.383923 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2e9007-9106-46cb-9da9-ace478d5395a", "name": "network-vif-plugged", "status": "completed", "tag": "347f5a03-1185-4b51-bae3-7e362ad5227a"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:55.393563 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:55.394032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:55.394458 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:55.406002 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] Creating event network-vif-plugged:347f5a03-1185-4b51-bae3-7e362ad5227a for instance 3f2e9007-9106-46cb-9da9-ace478d5395a on hv-cinder-85200 Aug 29 20:43:55.411299 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-ebf1556e-8da4-4050-b5d9-40e9733743d4 req-ad621841-873d-41d0-b7ad-3618297ffc7f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030979 Aug 29 20:43:55.412204 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 579/1183] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:55.780947 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:55.781513 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:55.787838 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:55.788359 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:55.788792 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:55.789481 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:55.789930 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:55.790349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:55.926998 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:55.934565 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b75b345c-5e3c-46ea-bf82-09cc2ad40636 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.157593 Aug 29 20:43:55.935133 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 605/1184] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:55 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:56.958654 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:56.959348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:56.966109 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:56.966592 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:56.967028 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:56.967716 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:56.968187 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:56.968620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.103278 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:57.110970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5d43e88b-e4eb-419c-8d1a-70c4c2e7439a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1265 microversion: 2.1 time: 0.157062 Aug 29 20:43:57.111537 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 580/1185] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:56 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:58.131735 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:58.132369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:58.138721 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.139204 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.139637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.140349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.140799 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.141223 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.269367 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:58.277750 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-dfc1682c-ab16-45c9-bbc7-a5c401854674 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1453 microversion: 2.1 time: 0.149937 Aug 29 20:43:58.278316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 606/1186] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:58 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:58.298353 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:58.298970 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:58.305377 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.305855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.306289 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.306976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.307431 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.307856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.438441 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:58.446466 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-7d40ab84-2419-4305-8a73-2f36dd302e79 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1453 microversion: 2.1 time: 0.151900 Aug 29 20:43:58.447032 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 581/1187] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:58 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:00.641688 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2e9007-9106-46cb-9da9-ace478d5395a", "tag": "347f5a03-1185-4b51-bae3-7e362ad5227a"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:00.651803 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:00.652400 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:00.652829 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:00.663620 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] Creating event network-changed:347f5a03-1185-4b51-bae3-7e362ad5227a for instance 3f2e9007-9106-46cb-9da9-ace478d5395a on hv-cinder-85200 Aug 29 20:44:00.668604 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-e0395967-b1aa-4b8f-a6e1-9e003264e7c6 req-45ffd12d-1e4f-4375-83bb-2069434fd435 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Aug 29 20:44:00.669184 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 607/1188] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:37.696738 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:37.697590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=78 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:37.702620 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-645489804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-247028261", "security_groups": [{"name": "tempest-secgroup-smoke-262447371"}], "block_device_mapping_v2": [{"uuid": "1f7e3167-323c-4541-87d5-d6f16a44d2f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af404a73-34f9-4bde-b0c8-4d7dda0a390d"}]}} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:37.817097 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.network.neutron [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] validate_networks() for [('af404a73-34f9-4bde-b0c8-4d7dda0a390d', None, None, None, None, None)] {{(pid=121468) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:45:38.200401 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:45:38.200827 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image limits 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:45:38.201310 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Flavor pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:45:38.201720 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Image pref 0:0:0 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:45:38.202161 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.virt.hardware [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121468) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:45:38.211767 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:38.212296 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:38.212736 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:38.213468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:38.213944 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:38.214361 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:38.231732 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:45:38.235668 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.quota [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Getting quotas for user 1d30c32e7ee441a38cdd67660fc81cd2 and project a55662f8acc54509b089b401af78ea9b. Resources: {'cores', 'ram', 'instances'} {{(pid=121468) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:45:38.292287 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Going to run 1 instances... {{(pid=121468) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:45:38.294413 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f7e3167-323c-4541-87d5-d6f16a44d2f4',volume_size=None,volume_type=None)] {{(pid=121468) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:45:38.916178 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-ba10790b-5ac2-456c-b009-559b9b3ffaa6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.221295 Aug 29 20:45:38.917170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 582/1189] 10.222.0.85 () {60 vars in 1147 bytes} [Mon Aug 29 20:45:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:45:38.926507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:38.927304 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:38.932902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-73ca4414-0362-4ac0-b08d-b2d35542207a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:38.936274 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-73ca4414-0362-4ac0-b08d-b2d35542207a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:38.990534 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-73ca4414-0362-4ac0-b08d-b2d35542207a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:38.997482 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-73ca4414-0362-4ac0-b08d-b2d35542207a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1093 microversion: 2.1 time: 0.073344 Aug 29 20:45:38.998062 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 608/1190] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:38 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:40.019145 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:40.019721 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:40.027326 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:40.027820 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:40.028318 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:40.029003 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:40.029528 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:40.029931 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:40.093955 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:40.101644 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-273cea69-14ab-49b1-a19e-1c33bfb14bd1 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1143 microversion: 2.1 time: 0.087149 Aug 29 20:45:40.102206 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 583/1191] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:40 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:41.122887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:41.123585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:41.132849 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:41.133416 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:41.147484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:41.147484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:41.147484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:41.147484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:41.210383 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:41.211033 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b0634750-0c92-43b3-9a50-68be6e1c47fa tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1191 microversion: 2.1 time: 0.092232 Aug 29 20:45:41.211583 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 609/1192] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:41 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:42.233163 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:42.234449 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:42.241093 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:42.241605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:42.242098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:42.242799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:42.243254 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:42.243674 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:42.318098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:42.326048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c5c96809-badd-4c8c-bf9f-8ed7992916c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1209 microversion: 2.1 time: 0.096872 Aug 29 20:45:42.326960 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 584/1193] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:42 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:43.349107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:43.350170 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:43.356556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:43.357045 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:43.357484 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:43.358191 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:43.359175 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:43.359602 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:43.494306 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:43.502309 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e63399ea-82a5-449d-ad9c-db9ce652b9f8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1276 microversion: 2.1 time: 0.157683 Aug 29 20:45:43.512474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 610/1194] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:43 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:43.742814 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175837ab-bb9f-493e-9b3c-f9e3823ea47d", "tag": "09f00479-346b-4ddc-8047-3650d5085d51"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:43.756459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:43.756982 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:43.757359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:43.770248 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] Creating event network-changed:09f00479-346b-4ddc-8047-3650d5085d51 for instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d on hv-cinder-85200 Aug 29 20:45:43.775856 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-b0a30653-a455-4789-bde9-8ef0e4064f71 req-0f775ac2-f712-4312-ada3-4997323c9257 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036854 Aug 29 20:45:43.776497 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 585/1195] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:44.522872 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:44.523481 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:44.530283 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:44.530767 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:44.531204 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:44.531896 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:44.532434 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:44.532856 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:44.667869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:44.676618 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a0cc68b9-ae5f-43fc-8aa6-c2b762926fd9 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.157507 Aug 29 20:45:44.677536 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 611/1196] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:44 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:45.699688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:45.700416 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:45.706590 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:45.707070 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:45.707508 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:45.708216 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:45.708670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:45.709098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:45.842167 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:45.850467 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-a5667963-f0a8-42e1-9f43-79168c27f055 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.155468 Aug 29 20:45:45.851034 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 586/1197] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:45 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:46.871877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:46.872474 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:46.879406 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:46.879877 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:46.880335 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:46.881009 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:46.881454 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:46.881869 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:47.017514 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:47.026059 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-459d9bf8-fe65-43ab-ad91-96d6d7d6804a tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.158104 Aug 29 20:45:47.026617 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 612/1198] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:46 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:48.047574 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:48.048222 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:48.054708 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:48.055192 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:48.055633 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:48.056356 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:48.057082 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:48.057520 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:48.192264 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:48.199999 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d7fd2d40-a6b2-4e6b-9597-4bde32de12ba tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.157033 Aug 29 20:45:48.200601 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 587/1199] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:48 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:49.222850 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:49.224808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:49.225851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell0:SELECT=2 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:49.230654 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:49.231136 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:49.231578 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:49.232290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:49.232747 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:49.233754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:49.366616 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:49.374369 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-49dc2d3d-fb87-46e8-ab20-cae93ea0b710 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.155423 Aug 29 20:45:49.374871 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 613/1200] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:49 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:50.395060 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:50.395621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:50.397526 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=2 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:50.398255 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell0:SELECT=6 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:50.403901 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:50.410393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:50.410393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:50.410393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:50.410393 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:50.410832 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:50.548677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:50.556544 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-86a5fd95-1d6f-4183-8050-2e0c854210c5 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.165391 Aug 29 20:45:50.557121 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 588/1201] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:50 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:51.576715 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:51.577316 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:51.583612 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:51.584093 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:51.585162 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:51.585847 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:51.586299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:51.586723 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:51.721784 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:51.729460 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-2c68d0d3-7d13-4ebe-991a-0077b506a446 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.156982 Aug 29 20:45:51.730020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 614/1202] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:51 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:52.754044 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:52.754673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:52.760678 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:52.761149 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:52.761579 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:52.762306 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:52.762753 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:52.763168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:52.895666 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:52.903673 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-d76cdd6a-c47b-4a47-a78b-8e3867507f11 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.156639 Aug 29 20:45:52.904274 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 589/1203] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:52 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:45:53.924345 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:53.924962 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:53.931380 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:53.931864 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:53.932332 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:53.933019 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:53.933470 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:53.933887 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:54.081786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:54.081786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-a69921ce-3b5e-498b-b95f-15e607d0c6a0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.152743 Aug 29 20:45:54.081786 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 615/1204] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:53 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:55.095425 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:55.096072 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:55.102530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:55.103010 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:55.103446 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:55.104138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:55.104627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:55.105048 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:55.237523 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:55.245240 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-97eab08b-5910-4e48-bc2f-bdc47c9ad509 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.154403 Aug 29 20:45:55.245806 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 590/1205] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:55 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:56.005992 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175837ab-bb9f-493e-9b3c-f9e3823ea47d", "name": "network-vif-plugged", "status": "completed", "tag": "09f00479-346b-4ddc-8047-3650d5085d51"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:56.016048 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:56.016552 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:56.016984 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:56.028101 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] Creating event network-vif-plugged:09f00479-346b-4ddc-8047-3650d5085d51 for instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d on hv-cinder-85200 Aug 29 20:45:56.033669 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-318c1da9-b840-43d4-b56b-c95fa9f2d96a req-968536d3-e4ef-46fb-b8ba-ae1a66446ca5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085501 Aug 29 20:45:56.034293 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 616/1206] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:56.319168 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:56.319788 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:56.325770 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:56.326252 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:56.326688 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:56.327397 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:56.328001 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:56.328459 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:56.497486 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:56.505993 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-8680070f-e7fa-4cd5-8c17-ccb5df0052c6 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.243429 Aug 29 20:45:56.506581 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 591/1207] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:56 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:57.532999 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:57.533710 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:57.539910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:57.540457 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:57.540899 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:57.541589 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:57.542043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:57.542468 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:57.670851 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:57.678537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-89563c74-53d0-4a5b-8f04-8590c0f5cf85 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1264 microversion: 2.1 time: 0.150986 Aug 29 20:45:57.679099 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 617/1208] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:57 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:58.699002 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:58.699612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:58.706609 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:58.707099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:58.707534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:58.708265 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:58.708718 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:58.709140 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:58.842138 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:58.850527 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-0ba3b2ff-32c6-4f07-807d-caeb74a2a5d8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1451 microversion: 2.1 time: 0.155497 Aug 29 20:45:58.851098 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 592/1209] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:58 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:58.870537 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:58.871065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:58.877653 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:58.878134 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:58.878584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:58.879263 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:58.879732 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:58.880535 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:59.019147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:59.027328 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c353ee10-6b91-408d-b949-d28d3d48cb0d tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1451 microversion: 2.1 time: 0.160731 Aug 29 20:45:59.027891 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 618/1210] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:58 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:46:01.080958 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175837ab-bb9f-493e-9b3c-f9e3823ea47d", "tag": "09f00479-346b-4ddc-8047-3650d5085d51"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:46:01.091273 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:01.091756 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:01.092219 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:01.103348 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] Creating event network-changed:09f00479-346b-4ddc-8047-3650d5085d51 for instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d on hv-cinder-85200 Aug 29 20:46:01.108354 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-eff58a55-8ade-4577-8883-50bec954f3f7 req-b778315a-5c8e-40e5-8dde-0a9ccc6370b3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085746 Aug 29 20:46:01.109565 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 593/1211] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:47:32.685932 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_api:SELECT=24 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:32.687060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG dbcounter [-] [121467] Writing DB stats nova_cell1:SELECT=56 {{(pid=121467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:32.688611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:47:32.688754 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d (ip 10.222.0.85) !!! Aug 29 20:47:32.689182 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:32.690075 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG dbcounter [-] [121468] Writing DB stats nova_cell1:SELECT=60 {{(pid=121468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:47:32.690624 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:47:32.690761 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Mon Aug 29 20:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d (ip 10.222.0.85) !!! Aug 29 20:47:32.691677 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:47:32.691799 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Mon Aug 29 20:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Aug 29 20:47:32.697532 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175837ab-bb9f-493e-9b3c-f9e3823ea47d", "tag": "09f00479-346b-4ddc-8047-3650d5085d51"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:47:32.703614 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:32.708946 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:32.709925 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:32.710085 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:32.710440 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:32.718988 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:32.719955 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:32.720094 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:32.720842 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:32.721365 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:32.721867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:32.722086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] Creating event network-changed:09f00479-346b-4ddc-8047-3650d5085d51 for instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d on hv-cinder-85200 Aug 29 20:47:32.733803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-ac9cb733-2cbd-4cbd-b033-a2279e2a2122 req-dfd48561-53ea-401e-b22b-679fe30c584a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040269 Aug 29 20:47:32.733803 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 594/1212] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:47:32.754210 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Going to try to terminate instance {{(pid=121467) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:47:33.102008 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-4e92513d-9251-4613-8a09-e9ee7318af19 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 204 len: 0 microversion: 2.1 time: 0.418065 Aug 29 20:47:33.102797 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 619/1213] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:47:32 2022] DELETE /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:47:33.112919 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:33.113675 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:33.121672 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:33.122261 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:33.122707 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:33.123411 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:33.123863 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:33.124621 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:33.261583 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:33.269461 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-c41a9331-7440-40a7-8bbe-f24824eebda4 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1575 microversion: 2.1 time: 0.161511 Aug 29 20:47:33.270043 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 595/1214] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:33 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:34.291480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:34.297043 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:34.298652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:34.299128 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:34.299556 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:34.300275 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:34.300727 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:34.301147 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:34.431053 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:34.438726 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-22b97fe6-4310-49ec-ba2b-570bf0680fa8 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1575 microversion: 2.1 time: 0.151532 Aug 29 20:47:34.439290 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 620/1215] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:34 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:47:35.460852 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:35.461605 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175837ab-bb9f-493e-9b3c-f9e3823ea47d", "name": "network-vif-deleted", "tag": "09f00479-346b-4ddc-8047-3650d5085d51"}]} {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:47:35.462131 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:35.467844 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:35.468349 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:35.468781 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:35.469467 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:35.469913 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:35.470418 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:35.470945 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:35.471419 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:35.471839 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:35.483731 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.compute.server_external_events [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] Creating event network-vif-deleted:09f00479-346b-4ddc-8047-3650d5085d51 for instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d on hv-cinder-85200 Aug 29 20:47:35.488811 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [req-02f26d83-bab7-496f-89ac-b93b638a441b req-d5b588c0-7ea5-4e0a-a10d-d2ae11ccf990 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031726 Aug 29 20:47:35.492895 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 596/1216] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:47:35.535585 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:35.543655 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-d7c60e9c-39de-466f-b5a9-b39866a0125b tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1390 microversion: 2.1 time: 0.086715 Aug 29 20:47:35.544251 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 621/1217] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:35 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:47:36.566542 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:36.567170 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:36.573877 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:36.574359 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:36.574800 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:36.575487 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:36.575943 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:36.576395 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:36.607325 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:36.607815 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:36.608275 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:36.608729 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.objects.instance [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lazy-loading 'fault' on Instance uuid 175837ab-bb9f-493e-9b3c-f9e3823ea47d {{(pid=121468) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:47:36.656099 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:36.663841 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-179f5a07-0456-4f3d-aa36-3d8308b4d1ca tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 200 len: 1229 microversion: 2.1 time: 0.102100 Aug 29 20:47:36.668213 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 597/1218] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:36 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:37.684841 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:37.685507 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 175837ab-bb9f-493e-9b3c-f9e3823ea47d] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:37.691935 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:37.692480 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:37.692923 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:37.693611 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:37.694064 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:37.694490 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:37.708816 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] HTTP exception thrown: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Request method failure captured: Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d HTTP/1.1 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSRRgNrYi_8trHCEGOpSNMZaFZ7_14oQGoBz6_ZzBCs1MxOGoq4ozlWUlfrcd9NQWTDJ5ZQnmV5gtDStaovzLuW-cBmY39lPEyOCto0pkPJzLy1RHU1RhByI67YfGhAOhrWZ9_BjdC18Sa0JBWeMnlwt0vC0a6_eV4rbr8oHBdxst-4 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:47:37.710551 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a55662f8acc54509b089b401af78ea9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 1d30c32e7ee441a38cdd67660fc81cd2 Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. Aug 29 20:47:37.712562 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': '175837ab-bb9f-493e-9b3c-f9e3823ea47d'} Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:47:37.713680 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. Aug 29 20:47:37.715461 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:37.717069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Returning 404 to user: Instance 175837ab-bb9f-493e-9b3c-f9e3823ea47d could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:47:37.717069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-78b8f99e-50b9-4929-ae2e-4de8f4cdf838 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d" status: 404 len: 111 microversion: 2.1 time: 0.031011 Aug 29 20:47:37.717069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 622/1219] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:37 2022] GET /compute/v2.1/servers/175837ab-bb9f-493e-9b3c-f9e3823ea47d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:47:41.134464 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:41.135636 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:41.136129 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2e9007-9106-46cb-9da9-ace478d5395a", "tag": "347f5a03-1185-4b51-bae3-7e362ad5227a"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:47:41.142398 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:41.144612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:41.144612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:41.144612 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:41.145065 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:41.145670 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:41.146299 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:41.146801 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:41.147237 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:41.159555 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] Creating event network-changed:347f5a03-1185-4b51-bae3-7e362ad5227a for instance 3f2e9007-9106-46cb-9da9-ace478d5395a on hv-cinder-85200 Aug 29 20:47:41.165744 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-23819e6d-7bf3-41f1-b610-24279b58829c req-7b48f0b7-df50-4be8-be3d-64182d6a2b2d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Aug 29 20:47:41.166346 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 623/1220] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:47:41.173936 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Going to try to terminate instance {{(pid=121468) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:47:41.535953 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-057570bc-208d-4c01-8913-37637e1a7fd2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 204 len: 0 microversion: 2.1 time: 0.405746 Aug 29 20:47:41.536855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 598/1221] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:47:41 2022] DELETE /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:47:41.546584 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:41.547287 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:41.553736 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:41.554231 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:41.554673 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:41.555379 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:41.555910 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:41.556372 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:41.711902 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:41.720216 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-b64cb3de-cebb-4c8d-918b-84e8c6793bbb tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1577 microversion: 2.1 time: 0.177820 Aug 29 20:47:41.724867 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 624/1222] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:41 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:42.742790 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:42.743495 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:42.750017 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:42.750500 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:42.750934 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:42.751627 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:42.752078 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:42.752534 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:42.886439 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:42.894452 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b074b804-8b61-467b-84f7-c08a5c66f732 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1577 microversion: 2.1 time: 0.157104 Aug 29 20:47:42.895029 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 599/1223] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:42 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:43.822145 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2e9007-9106-46cb-9da9-ace478d5395a", "name": "network-vif-deleted", "tag": "347f5a03-1185-4b51-bae3-7e362ad5227a"}]} {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:47:43.832206 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:43.832684 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:43.833106 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:43.844996 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.compute.server_external_events [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] Creating event network-vif-deleted:347f5a03-1185-4b51-bae3-7e362ad5227a for instance 3f2e9007-9106-46cb-9da9-ace478d5395a on hv-cinder-85200 Aug 29 20:47:43.850065 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [req-3cc1e147-c5b4-4cb6-968e-0b26cb9478b8 req-d645db31-bd48-4ec7-999e-396a1e75911d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Aug 29 20:47:43.850652 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 625/1224] 10.222.0.85 () {64 vars in 1317 bytes} [Mon Aug 29 20:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:47:43.917086 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:43.917703 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:43.924383 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:43.928341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:43.928341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:43.928341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:43.928341 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:43.928818 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:43.991091 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.policy [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121468) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:43.997867 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-f78be239-7474-452b-a265-27099e7df9cf tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1392 microversion: 2.1 time: 0.084794 Aug 29 20:47:43.998451 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 600/1225] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:43 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1392 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:45.022069 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:45.022770 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:45.029569 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:45.030060 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:45.030658 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:45.031353 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:45.031808 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:45.032262 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:45.068020 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:45.068657 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:45.069107 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:45.078352 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.objects.instance [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lazy-loading 'fault' on Instance uuid 3f2e9007-9106-46cb-9da9-ace478d5395a {{(pid=121467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:47:45.111637 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.policy [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30c32e7ee441a38cdd67660fc81cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55662f8acc54509b089b401af78ea9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121467) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:47:45.119794 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-3c90fdf0-8b64-4700-828a-e9a77b9696d0 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 200 len: 1230 microversion: 2.1 time: 0.103564 Aug 29 20:47:45.124150 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 626/1226] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:45 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:47:46.141165 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:46.141813 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: 3f2e9007-9106-46cb-9da9-ace478d5395a] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:46.148757 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.149235 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.149660 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.150388 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.150833 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.151247 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.165115 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] HTTP exception thrown: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Request method failure captured: Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a HTTP/1.1 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSRRgNrYi_8trHCEGOpSNMZaFZ7_14oQGoBz6_ZzBCs1MxOGoq4ozlWUlfrcd9NQWTDJ5ZQnmV5gtDStaovzLuW-cBmY39lPEyOCto0pkPJzLy1RHU1RhByI67YfGhAOhrWZ9_BjdC18Sa0JBWeMnlwt0vC0a6_eV4rbr8oHBdxst-4 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:47:46.166805 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a55662f8acc54509b089b401af78ea9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 1d30c32e7ee441a38cdd67660fc81cd2 Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. Aug 29 20:47:46.168399 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': '3f2e9007-9106-46cb-9da9-ace478d5395a'} Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:47:46.169241 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. Aug 29 20:47:46.170667 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.171903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Returning 404 to user: Instance 3f2e9007-9106-46cb-9da9-ace478d5395a could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:47:46.171903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-5d8e40e3-7b97-4d2a-ab09-fbcbcbc580ee tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a" status: 404 len: 111 microversion: 2.1 time: 0.031021 Aug 29 20:47:46.171903 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 601/1227] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:46 2022] GET /compute/v2.1/servers/3f2e9007-9106-46cb-9da9-ace478d5395a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:47:46.687329 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:46.687948 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.compute.api [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121467) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:46.694276 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.694753 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.695180 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.695865 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.696350 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.696769 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG oslo_concurrency.lockutils [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.740355 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.wsgi [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] HTTP exception thrown: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Request method failure captured: Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: request: DELETE /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 HTTP/1.1 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept: application/json Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Accept-Encoding: identity Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Connection: close Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Length: 0 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Content-Type: application/json Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Host: 10.222.0.85 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: Openstack-System-Scope: None Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: User-Agent: python-urllib3/1.26.12 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Auth-Token: gAAAAABjDSRRgNrYi_8trHCEGOpSNMZaFZ7_14oQGoBz6_ZzBCs1MxOGoq4ozlWUlfrcd9NQWTDJ5ZQnmV5gtDStaovzLuW-cBmY39lPEyOCto0pkPJzLy1RHU1RhByI67YfGhAOhrWZ9_BjdC18Sa0JBWeMnlwt0vC0a6_eV4rbr8oHBdxst-4 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Id: None Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Domain-Name: None Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Identity-Status: Confirmed Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Is-Admin-Project: True Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Id: default Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Domain-Name: Default Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Project-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Role: reader,member Aug 29 20:47:46.742000 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Roles: reader,member Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a55662f8acc54509b089b401af78ea9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-Tenant-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Id: default Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Domain-Name: Default Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Id: 1d30c32e7ee441a38cdd67660fc81cd2 Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: X-User-Name: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: method: > Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: exception: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.743745 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: action_args: {'id': 'f6423280-5be4-4cfd-8620-a0845146b181'} Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:47:46.744758 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.746140 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.748674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Returning 404 to user: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. {{(pid=121467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:47:46.748674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-e5bf465e-5a98-4666-90e9-b0445cfe6cf2 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 404 len: 111 microversion: 2.1 time: 0.059935 Aug 29 20:47:46.748674 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 627/1228] 10.222.0.85 () {58 vars in 1239 bytes} [Mon Aug 29 20:47:46 2022] DELETE /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:47:46.751974 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '>' {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:46.752617 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.compute.api [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] [instance: f6423280-5be4-4cfd-8620-a0845146b181] Fetching instance by UUID {{(pid=121468) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:47:46.758976 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.759468 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.759910 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.760647 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Acquiring lock "103c962f-eb80-4bbe-a755-160f136dba1f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:47:46.761122 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:47:46.761530 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG oslo_concurrency.lockutils [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Lock "103c962f-eb80-4bbe-a755-160f136dba1f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:47:46.775855 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.wsgi [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] HTTP exception thrown: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Request method failure captured: Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: request: GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 HTTP/1.1 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept: application/json Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Accept-Encoding: identity Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Connection: close Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Length: 0 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Content-Type: application/json Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Host: 10.222.0.85 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: Openstack-System-Scope: None Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: User-Agent: python-urllib3/1.26.12 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Auth-Token: gAAAAABjDSRRgNrYi_8trHCEGOpSNMZaFZ7_14oQGoBz6_ZzBCs1MxOGoq4ozlWUlfrcd9NQWTDJ5ZQnmV5gtDStaovzLuW-cBmY39lPEyOCto0pkPJzLy1RHU1RhByI67YfGhAOhrWZ9_BjdC18Sa0JBWeMnlwt0vC0a6_eV4rbr8oHBdxst-4 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Id: None Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Domain-Name: None Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Identity-Status: Confirmed Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Is-Admin-Project: True Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Id: default Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Domain-Name: Default Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Project-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Role: reader,member Aug 29 20:47:46.777414 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Roles: reader,member Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a55662f8acc54509b089b401af78ea9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a55662f8acc54509b089b401af78ea9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Id: a55662f8acc54509b089b401af78ea9b Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-Tenant-Name: tempest-TestVolumeBootPattern-283271432 Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Id: default Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Domain-Name: Default Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Id: 1d30c32e7ee441a38cdd67660fc81cd2 Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: X-User-Name: tempest-TestVolumeBootPattern-283271432-project Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: method: > Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: exception: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.779291 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: action_args: {'id': 'f6423280-5be4-4cfd-8620-a0845146b181'} Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: {{(pid=121468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:47:46.780313 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. Aug 29 20:47:46.782108 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: ERROR nova.api.openstack.wsgi Aug 29 20:47:46.783657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: DEBUG nova.api.openstack.wsgi [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Returning 404 to user: Instance f6423280-5be4-4cfd-8620-a0845146b181 could not be found. {{(pid=121468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:47:46.783657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: INFO nova.api.openstack.requestlog [None req-b74d8768-70f7-4af5-8fdd-613622952f00 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181" status: 404 len: 111 microversion: 2.1 time: 0.030645 Aug 29 20:47:46.783657 dv-cinder-852009-5-iscsi devstack@n-api.service[121468]: [pid: 121468|app: 0|req: 602/1229] 10.222.0.85 () {58 vars in 1236 bytes} [Mon Aug 29 20:47:46 2022] GET /compute/v2.1/servers/f6423280-5be4-4cfd-8620-a0845146b181 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:47:48.432092 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: DEBUG nova.api.openstack.wsgi [None req-c718455c-f35a-4b5b-b484-991097b7d390 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] Calling method '.version_select at 0x7f898782a550>' {{(pid=121467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:47:48.534525 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: INFO nova.api.openstack.requestlog [None req-c718455c-f35a-4b5b-b484-991097b7d390 tempest-TestVolumeBootPattern-283271432 tempest-TestVolumeBootPattern-283271432-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-247028261" status: 202 len: 0 microversion: 2.1 time: 0.106257 Aug 29 20:47:48.535135 dv-cinder-852009-5-iscsi devstack@n-api.service[121467]: [pid: 121467|app: 0|req: 628/1230] 10.222.0.85 () {58 vars in 1260 bytes} [Mon Aug 29 20:47:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-247028261 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)